Nov 03 19:48:15.804732 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 03 19:48:15.804742 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 03 19:48:15.804749 ip-10-0-134-71 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 03 19:48:15.805039 ip-10-0-134-71 systemd[1]: Failed to start Kubernetes Kubelet. Nov 03 19:48:26.054538 ip-10-0-134-71 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 03 19:48:26.054556 ip-10-0-134-71 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9b468d859aca4e8e9293184f519c1294 -- Nov 03 19:50:16.710130 ip-10-0-134-71 systemd[1]: Starting Kubernetes Kubelet... Nov 03 19:50:17.138242 ip-10-0-134-71 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:17.138242 ip-10-0-134-71 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 19:50:17.138242 ip-10-0-134-71 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:17.138242 ip-10-0-134-71 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:17.142575 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142470 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.142575 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142575 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142580 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142583 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142586 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142589 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142592 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142595 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142597 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142600 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142603 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142605 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142608 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142612 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142618 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142621 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142624 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142626 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142629 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142635 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.142643 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142639 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142641 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142644 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142647 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142650 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142652 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142655 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142659 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142663 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142666 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142669 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142672 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142674 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142677 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142679 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142682 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142684 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142687 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142689 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.143108 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142692 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142694 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142697 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142699 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142701 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142704 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142706 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142709 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142711 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142714 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142716 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142719 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142722 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142724 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142727 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142730 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142733 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142735 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142738 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142740 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.143551 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142743 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142745 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142747 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142750 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142752 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142755 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142757 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142761 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142763 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142766 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142768 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142771 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142773 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142776 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142779 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142782 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142785 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142787 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142790 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142792 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.144031 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142794 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142798 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142800 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142803 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142805 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142808 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142810 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142815 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142818 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142820 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142823 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142826 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142828 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142831 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142833 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142850 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142852 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142855 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142857 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.144531 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142860 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142862 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142865 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142867 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142870 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142874 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142876 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.142880 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143623 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143630 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143633 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143636 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143639 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143641 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143644 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143647 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143650 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143653 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143655 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143658 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.144987 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143662 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143665 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143667 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143671 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143675 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143677 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143680 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143682 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143685 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143687 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143690 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143693 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143695 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143698 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143700 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143703 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143706 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143708 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143711 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143713 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.145481 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143716 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143719 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143722 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143725 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143727 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143730 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143732 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143735 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143737 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143740 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143742 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143745 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143748 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143751 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143753 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143756 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143758 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143761 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143763 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143766 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.145978 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143768 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143770 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143773 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143775 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143778 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143780 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143782 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143785 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143787 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143790 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143792 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143795 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143797 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143800 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143802 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143805 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143807 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143810 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143813 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.146456 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143815 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143818 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143820 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143823 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143825 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143828 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143830 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143833 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143854 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143856 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143859 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143862 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143865 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143868 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143870 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143873 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143876 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143878 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143881 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143883 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.146957 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143886 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143888 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143893 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143897 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143900 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143902 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143906 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143908 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143912 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143915 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143918 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143921 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143923 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143926 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.143928 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144389 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144393 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144396 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144399 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.147438 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144402 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144404 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144407 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144409 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144412 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144414 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144417 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144420 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144422 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144425 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144427 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144430 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144432 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144434 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144437 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144439 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144442 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144445 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144448 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144451 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.147903 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144454 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144456 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144459 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144461 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144464 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144466 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144469 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144471 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144474 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144476 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144481 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144484 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144486 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144488 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144491 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144493 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144496 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144499 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144501 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144503 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.148367 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144506 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144508 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144511 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144513 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144516 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144520 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144523 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144526 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144529 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144532 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144535 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144538 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144542 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144547 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144550 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144553 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144557 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144560 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144563 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.148818 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144565 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144567 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144570 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144573 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144576 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144578 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144581 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144583 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144586 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144588 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144591 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144593 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144596 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144599 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144601 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144604 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144606 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144608 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144611 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.149285 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144613 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144616 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144619 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144621 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144624 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144626 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144629 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144631 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144634 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144636 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144639 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144641 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144644 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144646 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144649 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144651 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144654 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144656 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144659 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144661 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.149734 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144664 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144667 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144670 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.144672 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145735 2574 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145746 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145752 2574 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145757 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145761 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145764 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145769 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145773 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145776 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145782 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145786 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145789 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145792 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145795 2574 flags.go:64] FLAG: --cgroup-root="" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145798 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145800 2574 flags.go:64] FLAG: --client-ca-file="" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145803 2574 flags.go:64] FLAG: --cloud-provider="external" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145807 2574 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145812 2574 flags.go:64] FLAG: --cluster-domain="" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145815 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 19:50:17.150200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145818 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145821 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145825 2574 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145828 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145831 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145845 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145849 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145852 2574 flags.go:64] FLAG: --contention-profiling="false" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145855 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145858 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145861 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145864 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145868 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145871 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145874 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145877 2574 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145880 2574 flags.go:64] FLAG: --enable-server="true" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145883 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145888 2574 flags.go:64] FLAG: --event-burst="100" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145891 2574 flags.go:64] FLAG: --event-qps="50" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145894 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145898 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145901 2574 flags.go:64] FLAG: --eviction-hard="" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145905 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 19:50:17.150735 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145908 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145911 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145914 2574 flags.go:64] FLAG: --eviction-soft="" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145917 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145920 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145922 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145926 2574 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145928 2574 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145931 2574 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145934 2574 flags.go:64] FLAG: --feature-gates="" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145938 2574 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145941 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145944 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145947 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145950 2574 flags.go:64] FLAG: --healthz-port="10248" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145953 2574 flags.go:64] FLAG: --help="false" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145956 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145960 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145963 2574 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145966 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145969 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145973 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145976 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 19:50:17.151376 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145978 2574 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145981 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145984 2574 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145987 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145990 2574 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145994 2574 flags.go:64] FLAG: --kube-reserved="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.145998 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146001 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146004 2574 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146007 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146010 2574 flags.go:64] FLAG: --lock-file="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146012 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146016 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146018 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146024 2574 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146027 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146031 2574 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146034 2574 flags.go:64] FLAG: --logging-format="text" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146037 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146040 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146043 2574 flags.go:64] FLAG: --manifest-url="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146046 2574 flags.go:64] FLAG: --manifest-url-header="" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146050 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146053 2574 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146056 2574 flags.go:64] FLAG: --max-pods="110" Nov 03 19:50:17.152039 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146059 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146062 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146065 2574 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146068 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146071 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146073 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146076 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146083 2574 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146086 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146089 2574 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146092 2574 flags.go:64] FLAG: --pod-cidr="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146095 2574 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146102 2574 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146105 2574 flags.go:64] FLAG: --pods-per-core="0" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146108 2574 flags.go:64] FLAG: --port="10250" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146111 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146114 2574 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0ea55a948fc3dee35" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146117 2574 flags.go:64] FLAG: --qos-reserved="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146120 2574 flags.go:64] FLAG: --read-only-port="10255" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146122 2574 flags.go:64] FLAG: --register-node="true" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146125 2574 flags.go:64] FLAG: --register-with-taints="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146132 2574 flags.go:64] FLAG: --registry-burst="10" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146135 2574 flags.go:64] FLAG: --registry-qps="5" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146138 2574 flags.go:64] FLAG: --reserved-cpus="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146141 2574 flags.go:64] FLAG: --reserved-memory="" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146145 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 19:50:17.152635 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146148 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146151 2574 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146154 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146156 2574 flags.go:64] FLAG: --runonce="false" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146159 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146162 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146165 2574 flags.go:64] FLAG: --seccomp-default="false" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146168 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146170 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146173 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146176 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146180 2574 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146182 2574 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146185 2574 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146188 2574 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146190 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146193 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146196 2574 flags.go:64] FLAG: --system-cgroups="" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146200 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146205 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146208 2574 flags.go:64] FLAG: --tls-cert-file="" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146211 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146215 2574 flags.go:64] FLAG: --tls-min-version="" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146218 2574 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146221 2574 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 19:50:17.153523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146224 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146227 2574 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146230 2574 flags.go:64] FLAG: --v="2" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146234 2574 flags.go:64] FLAG: --version="false" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146238 2574 flags.go:64] FLAG: --vmodule="" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146242 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146246 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146417 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146421 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146424 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146427 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146429 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146431 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146434 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146436 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146440 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146442 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146444 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146447 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146449 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146452 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.154594 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146454 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146457 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146460 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146463 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146468 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146472 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146475 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146479 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146481 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146484 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146486 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146489 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146491 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146494 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146496 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146499 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146501 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146503 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146506 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146509 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.155503 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146511 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146514 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146516 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146519 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146521 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146524 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146526 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146528 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146531 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146533 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146536 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146539 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146542 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146546 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146548 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146551 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146554 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146558 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146561 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.156384 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146564 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146566 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146569 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146571 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146574 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146576 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146579 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146581 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146584 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146587 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146589 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146592 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146594 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146597 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146599 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146601 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146604 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146606 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146609 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.157094 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146611 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146614 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146616 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146619 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146621 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146623 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146626 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146628 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146631 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146633 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146637 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146641 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146644 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146646 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146649 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146651 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146654 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146656 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146659 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.157715 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146661 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146664 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146666 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146669 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146671 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146673 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146676 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146679 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146681 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146684 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146686 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146688 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146691 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146693 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146696 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.146721 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:17.158181 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146755 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146759 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146762 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146765 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146767 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146770 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146772 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146776 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146778 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146782 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146785 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146788 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146790 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146793 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146795 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146798 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146800 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146803 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146805 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.158556 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146808 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146810 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146813 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146815 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146818 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146821 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146824 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146826 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146829 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146831 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146834 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146855 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146858 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146871 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146874 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146876 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146878 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146881 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146883 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146886 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.159014 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146889 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146892 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146896 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146899 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146901 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146903 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146906 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146908 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146911 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146913 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146916 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146918 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146921 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146924 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146926 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146928 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146931 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146933 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146936 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146939 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.159495 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146941 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146944 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146948 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146951 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146954 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146957 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146960 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146963 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146965 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146968 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146971 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146973 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146976 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146979 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146983 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146986 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146988 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146991 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146993 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.160095 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146996 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.146998 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147001 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147003 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147006 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147008 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147011 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147013 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147016 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147018 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147022 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147026 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147029 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147032 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147035 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147038 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147040 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147043 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147045 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.160529 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147047 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147050 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147052 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147055 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147057 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147059 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147062 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147066 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.147071 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.157702 2574 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.157721 2574 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.157754 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.157762 2574 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157875 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157883 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157887 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157890 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157893 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157896 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.160984 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157899 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157901 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157904 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157908 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157912 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157916 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157919 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157921 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157925 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157929 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157932 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157936 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157939 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157942 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157945 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157948 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157950 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157953 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.161434 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157956 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157958 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157966 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157969 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157972 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157975 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157978 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157981 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157983 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157986 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157988 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157991 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157993 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157996 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.157998 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158001 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158003 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158006 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158008 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158011 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.161865 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158014 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158016 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158018 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158021 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158023 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158026 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158028 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158031 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158033 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158036 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158038 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158041 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158043 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158046 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158049 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158051 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158054 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158057 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158060 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158062 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.162326 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158065 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158067 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158069 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158072 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158074 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158077 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158079 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158081 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158084 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158102 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158106 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158109 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158112 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158115 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158117 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158121 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158124 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158126 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158129 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158131 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.162786 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158133 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158136 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158138 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158148 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158152 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158157 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158161 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158165 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158168 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158170 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158173 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158175 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158178 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158180 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158183 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158186 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158188 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158191 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158193 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.163288 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158196 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158198 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158201 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.158230 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158388 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158394 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158397 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158399 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158402 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158405 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158408 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158410 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158413 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158416 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158419 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158421 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.163719 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158424 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158426 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158429 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158431 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158434 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158436 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158439 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158441 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158444 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158446 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158448 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158451 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158454 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158457 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158460 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158462 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158466 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158470 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158472 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158475 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.164113 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158477 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158479 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158482 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158484 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158487 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158490 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158493 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158495 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158498 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158500 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158503 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158505 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158508 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158510 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158513 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158515 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158517 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158520 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158522 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.164563 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158525 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158527 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158530 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158532 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158535 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158537 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158540 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158542 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158545 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158547 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158550 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158552 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158554 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158557 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158559 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158562 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158564 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158567 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158570 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.165016 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158573 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158576 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158578 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158581 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158584 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158587 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158589 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158592 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158594 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158596 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158599 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158601 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158604 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158607 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158609 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158612 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158614 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158616 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158619 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158621 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.165462 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158624 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158626 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158629 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158631 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158634 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158636 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158639 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158641 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158646 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158649 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158651 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158654 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158656 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158659 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158662 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.165939 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158666 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.158689 2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158721 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158725 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158728 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158730 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158733 2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158735 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158738 2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158740 2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158743 2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158745 2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158748 2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158750 2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158753 2574 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158756 2574 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:17.166286 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158758 2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158761 2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158763 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158766 2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158768 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158770 2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158773 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158775 2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158777 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158780 2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158784 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158787 2574 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158789 2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158792 2574 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158796 2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158799 2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158803 2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158806 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158808 2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158811 2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:17.166662 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158813 2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158816 2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158818 2574 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158821 2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158823 2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158826 2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158828 2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158830 2574 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158833 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158852 2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158857 2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158860 2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158862 2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158865 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158867 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158870 2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158873 2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158875 2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158878 2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:17.167168 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158880 2574 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158882 2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158885 2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158889 2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158892 2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158894 2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158897 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158899 2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158902 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158904 2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158908 2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158910 2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158913 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158915 2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158918 2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158920 2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158923 2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158926 2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158928 2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:17.167596 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158931 2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158937 2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158940 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158942 2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158945 2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158947 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158950 2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158952 2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158955 2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158957 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158960 2574 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158962 2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158965 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158967 2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158969 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158972 2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158976 2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158979 2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158982 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158985 2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:17.168069 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158987 2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158990 2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158993 2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158995 2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.158998 2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159001 2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159004 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159006 2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159008 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159011 2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159013 2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159016 2574 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159018 2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:17.159023 2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.159075 2574 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.163257 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.164318 2574 server.go:1014] "Starting client certificate rotation" Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.164420 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:17.168573 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.164450 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:17.169014 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.166616 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:17.169014 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.168027 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:17.179959 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.179938 2574 log.go:25] "Validated CRI v1 runtime API" Nov 03 19:50:17.183906 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.183890 2574 log.go:25] "Validated CRI v1 image API" Nov 03 19:50:17.184782 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.184756 2574 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 19:50:17.190609 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.190589 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dc86330e-7710-451a-b020-3e93fe20729f:/dev/nvme0n1p3 df59d6f4-9e2a-4b46-baba-ad0e2272110e:/dev/nvme0n1p4] Nov 03 19:50:17.190672 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.190607 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 19:50:17.196469 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.196365 2574 manager.go:217] Machine: {Timestamp:2026-11-03 19:50:17.195888699 +0000 UTC m=+0.352877468 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099425 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aadba338d4805402cca6e84d6b9aa SystemUUID:ec2aadba-338d-4805-402c-ca6e84d6b9aa BootID:9b468d85-9aca-4e8e-9293-184f519c1294 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:54:51:24:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:54:51:24:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:12:30:d0:5a:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 19:50:17.197133 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.197122 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 19:50:17.197214 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.197203 2574 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 19:50:17.200211 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200189 2574 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 19:50:17.200368 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200220 2574 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-71.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 19:50:17.200970 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200960 2574 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 19:50:17.201002 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200972 2574 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 19:50:17.201002 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200983 2574 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:17.201002 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.200998 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:17.202357 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.202347 2574 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 19:50:17.208626 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.208614 2574 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 19:50:17.208754 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.208745 2574 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 19:50:17.209569 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.209560 2574 kubelet.go:493] "Attempting to sync node with API server" Nov 03 19:50:17.209605 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.209577 2574 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 19:50:17.209605 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.209594 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 19:50:17.209605 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.209603 2574 kubelet.go:405] "Adding apiserver pod source" Nov 03 19:50:17.209688 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.209613 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 19:50:17.210540 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.210527 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:17.213662 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.213462 2574 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 19:50:17.220166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.220153 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:17.220965 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.220953 2574 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 19:50:17.221009 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.220984 2574 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 19:50:17.221139 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221130 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 19:50:17.221168 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221146 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 19:50:17.221168 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221152 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 19:50:17.221168 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221158 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 19:50:17.221168 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221163 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 19:50:17.221168 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221168 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 19:50:17.221785 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221778 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 19:50:17.221813 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221786 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 19:50:17.221813 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221793 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 19:50:17.221813 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221799 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 19:50:17.221813 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221807 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 19:50:17.221999 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.221815 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 19:50:17.223546 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.223537 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 19:50:17.223579 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.223547 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 19:50:17.227426 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.227409 2574 server.go:1263] "Started kubelet" Nov 03 19:50:17.227586 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.227549 2574 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 19:50:17.227630 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.227543 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 19:50:17.227630 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.227625 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 19:50:17.228127 ip-10-0-134-71 systemd[1]: Started Kubernetes Kubelet. Nov 03 19:50:17.229073 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.229061 2574 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 19:50:17.230808 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.230794 2574 server.go:317] "Adding debug handlers to kubelet server" Nov 03 19:50:17.235028 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.235010 2574 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 19:50:17.236268 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.236254 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:17.236912 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.236895 2574 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 19:50:17.237034 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.237000 2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" Nov 03 19:50:17.238516 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.237745 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 19:50:17.238620 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.238604 2574 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 19:50:17.238686 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.238679 2574 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 19:50:17.238908 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.238897 2574 reconstruct.go:97] "Volume reconstruction finished" Nov 03 19:50:17.239519 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239403 2574 reconciler.go:29] "Reconciler: start to sync state" Nov 03 19:50:17.239519 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239276 2574 factory.go:55] Registering systemd factory Nov 03 19:50:17.239519 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239433 2574 factory.go:223] Registration of the systemd container factory successfully Nov 03 19:50:17.239872 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239825 2574 factory.go:153] Registering CRI-O factory Nov 03 19:50:17.239872 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239861 2574 factory.go:223] Registration of the crio container factory successfully Nov 03 19:50:17.239966 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239911 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 19:50:17.239966 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239933 2574 factory.go:103] Registering Raw factory Nov 03 19:50:17.239966 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.239955 2574 manager.go:1199] Started watching for new ooms in manager Nov 03 19:50:17.241064 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.241050 2574 manager.go:319] Starting recovery of all containers Nov 03 19:50:17.252551 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.252529 2574 manager.go:324] Recovery completed Nov 03 19:50:17.257552 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.257532 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.264717 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.264701 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.264817 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.264735 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.264817 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.264752 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.265297 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.265283 2574 cpu_manager.go:226] "Starting" policy="none" Nov 03 19:50:17.265297 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.265294 2574 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 19:50:17.265458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.265315 2574 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 19:50:17.265458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.265297 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.266148 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.266133 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.266215 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.266166 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.266215 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.266181 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.267480 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.267459 2574 policy_none.go:50] "Start" Nov 03 19:50:17.267480 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.267476 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 19:50:17.267558 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.267486 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 19:50:17.269476 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.269463 2574 policy_none.go:44] "Start" Nov 03 19:50:17.302229 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.302093 2574 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329180 2574 manager.go:341] "Starting Device Plugin manager" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.329210 2574 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329218 2574 server.go:87] "Starting device plugin registration server" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329425 2574 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329435 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329574 2574 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329635 2574 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.329642 2574 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.330230 2574 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 19:50:17.341034 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.330284 2574 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" Nov 03 19:50:17.368955 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.368930 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 19:50:17.370313 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.370262 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 19:50:17.370313 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.370283 2574 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 19:50:17.370313 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.370305 2574 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 19:50:17.370476 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.370336 2574 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 19:50:17.377260 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.377241 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-71.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 19:50:17.377340 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.377243 2574 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-71.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 03 19:50:17.377964 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.377227 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-71.us-west-1.compute.internal.18e4a0dbbce00e2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 19:50:17.227382314 +0000 UTC m=+0.384371082,LastTimestamp:2026-11-03 19:50:17.227382314 +0000 UTC m=+0.384371082,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.us-west-1.compute.internal,}" Nov 03 19:50:17.430065 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.430016 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.430780 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.430762 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.430891 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.430793 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.430891 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.430806 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.430891 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.430830 2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.447411 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.447394 2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 19:50:17.447502 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.447432 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrmlj" Nov 03 19:50:17.471437 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.471406 2574 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal"] Nov 03 19:50:17.471528 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.471469 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.472308 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.472293 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.472380 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.472319 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.472380 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.472329 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.474176 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474164 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.474326 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.474366 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474342 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.474961 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474946 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.474961 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474956 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.475101 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474978 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.475101 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474977 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.475101 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.475002 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.475101 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.474989 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.476786 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.476771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.476881 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.476798 2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:17.477632 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.477617 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:17.477713 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.477642 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:17.477713 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.477656 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:17.500701 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.500685 2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.504121 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.504103 2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.539181 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.539162 2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:17.540229 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.540215 2574 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:17.540283 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.540251 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.540283 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.540271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.540363 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.540289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.638377 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.638354 2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:17.638619 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.638605 2574 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:17.639668 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.639653 2574 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.639743 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:17.639673 2574 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-71.us-west-1.compute.internal\": node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" Nov 03 19:50:17.640626 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.640671 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.640671 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.640765 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.640765 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640706 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.640765 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.640720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.737797 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.737731 2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.798819 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.798785 2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:17.798955 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.798925 2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.803963 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.803950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.806859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.806811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:17.856699 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:17.856672 2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:18.164530 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.164456 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 19:50:18.165089 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.164565 2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 19:50:18.165089 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.164648 2574 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 19:50:18.165089 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:18.164633 2574 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ac5c5bdcb9dd34b2db451ae290864639-b04dcf4e4c158c13.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-134-71.us-west-1.compute.internal.18e4a0dbbf1a5c84\": read tcp 10.0.134.71:53672->18.220.126.244:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-134-71.us-west-1.compute.internal.18e4a0dbbf1a5c84 default 4992 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-71.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-71.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-71.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 19:50:17 +0000 UTC,LastTimestamp:2026-11-03 19:50:17.43080973 +0000 UTC m=+0.587798498,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-71.us-west-1.compute.internal,}" Nov 03 19:50:18.210408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.210388 2574 apiserver.go:52] "Watching apiserver" Nov 03 19:50:18.236516 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.236494 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:18.451662 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.451587 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:45:18 +0000 UTC" deadline="2028-06-27 09:17:04.817623179 +0000 UTC" Nov 03 19:50:18.451662 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.451618 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14437h26m46.366008069s" Nov 03 19:50:18.482757 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.482734 2574 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 19:50:18.483072 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.483053 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mcf55","openshift-network-operator/iptables-alerter-6vq2k","kube-system/global-pull-secret-syncer-tcj5c","kube-system/konnectivity-agent-98mpb","openshift-dns/node-resolver-fbwpl","openshift-multus/multus-additional-cni-plugins-56szs","openshift-multus/network-metrics-daemon-2wjbn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr","openshift-multus/multus-w2c8k","openshift-ovn-kubernetes/ovnkube-node-vz8bm","kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal","openshift-image-registry/node-ca-m4dlp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-2sfnd"] Nov 03 19:50:18.485270 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.485254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:18.485337 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:18.485321 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:18.487082 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.487069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:18.488928 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.488913 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:18.488999 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:18.488966 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:18.490908 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.490891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:18.492883 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.492866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:18.494870 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.494855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.496917 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.496901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:18.497009 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:18.496967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:18.498923 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.498901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.501043 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.501028 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.503261 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.503246 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.505412 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.505397 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:18.507509 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.507491 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.538772 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.538754 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 19:50:18.541458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.541441 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:18.541611 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.541598 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:18.541723 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.541711 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 19:50:18.543881 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.543834 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftqzb\"" Nov 03 19:50:18.546235 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:18.546330 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546253 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 19:50:18.546330 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546330 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546299 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546330 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546316 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-62dzj\"" Nov 03 19:50:18.546473 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.546473 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546473 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546582 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qsh8\" (UniqueName: \"kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546582 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:18.546582 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:18.546582 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.546582 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.546730 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.546730 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.546730 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.546730 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.546730 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546712 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qc46\" (UniqueName: \"kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546752 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsspw\" (UniqueName: \"kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:18.546915 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.546992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547166 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547321 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pc2lm\"" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547445 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547493 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfw4\" (UniqueName: \"kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95sb9\" (UniqueName: \"kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.547938 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsc2\" (UniqueName: \"kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547912 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.547987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nq72\" (UniqueName: \"kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xljcg\" (UniqueName: \"kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:18.548408 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrsf\" (UniqueName: \"kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:18.548859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:18.548859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:18.548859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.548288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:18.549396 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.549382 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvbsg\"" Nov 03 19:50:18.552038 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.552025 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 19:50:18.553350 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.553338 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n4htx\"" Nov 03 19:50:18.555245 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.555228 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-72xbf\"" Nov 03 19:50:18.557401 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.557385 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 19:50:18.557484 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.557410 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tfxx4\"" Nov 03 19:50:18.588924 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.588905 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dqdcf\"" Nov 03 19:50:18.588924 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.588916 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nq97\"" Nov 03 19:50:18.589907 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.589888 2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 19:50:18.589965 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:18.589941 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9vf9" Nov 03 19:50:19.761765 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.761748 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 19:50:19.761858 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.761797 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.761960 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.761945 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762002 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.761989 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762062 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762052 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.762090 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762066 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 19:50:19.762090 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762069 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.762143 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762111 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.762143 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762127 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.762194 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762141 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 19:50:19.762349 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762314 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762349 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762327 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 19:50:19.762349 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762342 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 19:50:19.762549 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762363 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 19:50:19.762549 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762398 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762549 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762467 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 19:50:19.762549 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762539 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 19:50:19.762712 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762573 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762712 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762575 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 19:50:19.762712 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762599 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 19:50:19.762828 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.762815 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 19:50:19.769832 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:19.769886 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.769886 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.769886 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769960 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770003 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.769955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770319 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770299 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770384 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfw4\" (UniqueName: \"kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95sb9\" (UniqueName: \"kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.770719 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770786 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770974 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.770915 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.771362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771163 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771204 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771296 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsc2\" (UniqueName: \"kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.772174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771590 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.771589 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771652 2574 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.771713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.271692207 +0000 UTC m=+2.308282910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq72\" (UniqueName: \"kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xljcg\" (UniqueName: \"kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.772968 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.771987 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrsf\" (UniqueName: \"kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772288 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772343 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772365 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.773859 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772401 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qsh8\" (UniqueName: \"kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772813 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772986 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773020 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.772878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.774523 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.773072 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773212 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.773269 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.273231337 +0000 UTC m=+2.309822033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773352 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qc46\" (UniqueName: \"kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773449 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsspw\" (UniqueName: \"kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773669 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.775209 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773697 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773705 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.773928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.774984 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.775146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.776000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.775820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.776760 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.776210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:19.834216 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.834154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95sb9\" (UniqueName: \"kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:19.834216 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.834156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfw4\" (UniqueName: \"kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:19.838985 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.838960 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljcg\" (UniqueName: \"kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.839334 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.839314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsc2\" (UniqueName: \"kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:19.839834 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.839818 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:19.839834 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.839834 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:19.839940 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.839844 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:19.839940 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:19.839889 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.339876195 +0000 UTC m=+2.376466889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:19.841362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.841334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qc46\" (UniqueName: \"kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:19.842346 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.842323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qsh8\" (UniqueName: \"kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:19.842512 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.842495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrsf\" (UniqueName: \"kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:19.843019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.842997 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq72\" (UniqueName: \"kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:19.844031 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.844015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsspw\" (UniqueName: \"kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:19.939566 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.939514 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:19.960963 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.960936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:19.982227 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:19.982206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:20.006825 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.006789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:20.015584 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.015553 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:20.030912 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.030889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w2c8k" Nov 03 19:50:20.051610 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.051582 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:20.052624 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.052600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:20.054546 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.054521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:20.135841 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.135800 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d8647af64bbafa0ef71ce378297a23.slice/crio-52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76 WatchSource:0}: Error finding container 52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76: Status 404 returned error can't find the container with id 52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76 Nov 03 19:50:20.136251 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.136215 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3dd5bb7ddeae35bdfefc31e3d9883e.slice/crio-904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f WatchSource:0}: Error finding container 904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f: Status 404 returned error can't find the container with id 904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f Nov 03 19:50:20.140696 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.140680 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:50:20.277843 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.277805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:20.277987 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.277877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:20.277987 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.277961 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:20.277987 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.277960 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:20.278082 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.278020 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:21.278003927 +0000 UTC m=+3.314594623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:20.278082 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.278033 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:21.2780281 +0000 UTC m=+3.314618795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:20.378557 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.378469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:20.379197 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.378638 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:20.379197 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.378658 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:20.379197 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.378669 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:20.379197 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:20.378723 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:21.378707832 +0000 UTC m=+3.415298528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:20.428078 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.428049 2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:20.494494 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.494446 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"0b3dd5bb7ddeae35bdfefc31e3d9883e","Type":"ContainerStarted","Data":"904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f"} Nov 03 19:50:20.495422 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.495402 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerStarted","Data":"52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76"} Nov 03 19:50:20.712957 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.712854 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:19 +0000 UTC" deadline="2028-07-06 08:34:52.290562822 +0000 UTC" Nov 03 19:50:20.712957 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.712901 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14652h44m31.57766448s" Nov 03 19:50:20.757965 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.757942 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a161ff9_9173_4eb5_ae3d_de5622dc53e1.slice/crio-2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673 WatchSource:0}: Error finding container 2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673: Status 404 returned error can't find the container with id 2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673 Nov 03 19:50:20.801653 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:20.801618 2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:20.803100 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.803076 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ba704c_b438_43e8_af83_f2cd1fa4eabf.slice/crio-eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7 WatchSource:0}: Error finding container eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7: Status 404 returned error can't find the container with id eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7 Nov 03 19:50:20.878402 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.878358 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16949730_542f_4d13_ac31_b546e250b748.slice/crio-0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598 WatchSource:0}: Error finding container 0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598: Status 404 returned error can't find the container with id 0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598 Nov 03 19:50:20.894138 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.894115 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259fae14_47ad_4823_a247_bdccc4ff5cca.slice/crio-1d7b8f251a64066493d865b0541ae738e053dd7903b0e41eacd53dc50fabd03a WatchSource:0}: Error finding container 1d7b8f251a64066493d865b0541ae738e053dd7903b0e41eacd53dc50fabd03a: Status 404 returned error can't find the container with id 1d7b8f251a64066493d865b0541ae738e053dd7903b0e41eacd53dc50fabd03a Nov 03 19:50:20.918514 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.918486 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda847b75d_17e0_437d_8409_feb11d9a6948.slice/crio-d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318 WatchSource:0}: Error finding container d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318: Status 404 returned error can't find the container with id d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318 Nov 03 19:50:20.924522 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.924499 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7880dce_853f_4193_a6c2_0a3f34fa5045.slice/crio-40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062 WatchSource:0}: Error finding container 40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062: Status 404 returned error can't find the container with id 40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062 Nov 03 19:50:20.925292 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.925271 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a46691b_91f0_4f4c_b0ef_45bcf43adc5b.slice/crio-0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4 WatchSource:0}: Error finding container 0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4: Status 404 returned error can't find the container with id 0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4 Nov 03 19:50:20.927784 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:20.927670 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f2e664_d2c8_4a59_b220_cfa01689c0de.slice/crio-153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b WatchSource:0}: Error finding container 153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b: Status 404 returned error can't find the container with id 153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b Nov 03 19:50:21.284445 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.284407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:21.284638 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.284465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:21.284713 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.284679 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:21.284770 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.284739 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:23.284721027 +0000 UTC m=+5.321311716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:21.284846 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.284831 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:21.284899 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.284869 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:23.284857201 +0000 UTC m=+5.321447888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:21.384819 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.384783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:21.385413 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.384925 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:21.385413 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.384940 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:21.385413 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.384951 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:21.385413 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.385001 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:23.384983068 +0000 UTC m=+5.421573768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:21.491533 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.491506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:21.491675 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.491610 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:21.491734 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.491694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:21.491777 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.491761 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:21.491836 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.491824 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:21.491934 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:21.491906 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:21.498200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.498173 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m4dlp" event={"ID":"c7880dce-853f-4193-a6c2-0a3f34fa5045","Type":"ContainerStarted","Data":"40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062"} Nov 03 19:50:21.499875 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.499838 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318"} Nov 03 19:50:21.501298 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.501268 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" event={"ID":"259fae14-47ad-4823-a247-bdccc4ff5cca","Type":"ContainerStarted","Data":"1d7b8f251a64066493d865b0541ae738e053dd7903b0e41eacd53dc50fabd03a"} Nov 03 19:50:21.502604 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.502571 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerStarted","Data":"153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b"} Nov 03 19:50:21.503780 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.503755 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" event={"ID":"16949730-542f-4d13-ac31-b546e250b748","Type":"ContainerStarted","Data":"0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598"} Nov 03 19:50:21.505112 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.505093 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6vq2k" event={"ID":"60ba704c-b438-43e8-af83-f2cd1fa4eabf","Type":"ContainerStarted","Data":"eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7"} Nov 03 19:50:21.506200 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.506178 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbwpl" event={"ID":"1a161ff9-9173-4eb5-ae3d-de5622dc53e1","Type":"ContainerStarted","Data":"2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673"} Nov 03 19:50:21.507169 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.507150 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-98mpb" event={"ID":"7d2c4acc-8137-41ae-b516-4295e9ba1556","Type":"ContainerStarted","Data":"2774a6a33fe6e6684a03e078f783e4263f48eaf57ef572a36d054b8ef8d10985"} Nov 03 19:50:21.508203 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.508185 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2c8k" event={"ID":"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b","Type":"ContainerStarted","Data":"0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4"} Nov 03 19:50:21.713741 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.713641 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:19 +0000 UTC" deadline="2028-05-22 18:35:36.026271867 +0000 UTC" Nov 03 19:50:21.713741 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:21.713695 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13582h45m14.312581033s" Nov 03 19:50:23.303098 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.303056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:23.303568 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.303152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:23.303568 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.303365 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:23.303568 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.303443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:27.30342482 +0000 UTC m=+9.340015527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:23.303568 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.303462 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:23.303568 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.303490 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:27.303480936 +0000 UTC m=+9.340071632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:23.403503 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.403472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:23.403670 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.403648 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:23.403748 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.403678 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:23.403748 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.403693 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:23.403851 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.403754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:27.403734539 +0000 UTC m=+9.440325234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:23.491281 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.491255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:23.491399 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.491376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:23.491444 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.491434 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:23.491541 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.491503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:23.491615 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:23.491558 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:23.491763 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:23.491633 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:24.538499 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:24.537674 2574 generic.go:356] "Generic (PLEG): container finished" podID="e2d8647af64bbafa0ef71ce378297a23" containerID="cf3d4df051b6183d953377412c77471e7ead9e8c2378b95777c3b5595a516f3c" exitCode=0 Nov 03 19:50:24.538499 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:24.537766 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerDied","Data":"cf3d4df051b6183d953377412c77471e7ead9e8c2378b95777c3b5595a516f3c"} Nov 03 19:50:24.559629 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:24.554269 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"0b3dd5bb7ddeae35bdfefc31e3d9883e","Type":"ContainerStarted","Data":"ee3e94574defa78436171eeadbb785e1f7071d41367cbecbd3524887b46fb667"} Nov 03 19:50:24.570448 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:24.570408 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerStarted","Data":"62232839e81ea8855ebadddd437ad5257f784973eddb51669e71b0cb33221e2e"} Nov 03 19:50:25.491195 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.491162 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:25.491398 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:25.491327 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:25.491472 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.491408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:25.491532 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:25.491484 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:25.491588 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.491547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:25.491639 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:25.491621 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:25.576612 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.576574 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="62232839e81ea8855ebadddd437ad5257f784973eddb51669e71b0cb33221e2e" exitCode=0 Nov 03 19:50:25.577046 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.576674 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"62232839e81ea8855ebadddd437ad5257f784973eddb51669e71b0cb33221e2e"} Nov 03 19:50:25.586797 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.586762 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerStarted","Data":"4378a9dec1978c2e35896c4f04afcf370ceee7a6e1d1648c818a52ba0edd9e8b"} Nov 03 19:50:25.753055 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:25.752948 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" podStartSLOduration=7.752929617 podStartE2EDuration="7.752929617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:24.901167214 +0000 UTC m=+6.937757914" watchObservedRunningTime="2026-11-03 19:50:25.752929617 +0000 UTC m=+7.789520322" Nov 03 19:50:26.591829 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:26.591776 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-98mpb" event={"ID":"7d2c4acc-8137-41ae-b516-4295e9ba1556","Type":"ContainerStarted","Data":"52897f9853cf8dfce10bb8f1107887a2d2b71f8eadead93499e3c22be6e703ec"} Nov 03 19:50:26.595592 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:26.595229 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m4dlp" event={"ID":"c7880dce-853f-4193-a6c2-0a3f34fa5045","Type":"ContainerStarted","Data":"59c8ae2cbed8d93753ddfba93cfbbccad0426683b30ee29f84be9c4b0a8f6dcd"} Nov 03 19:50:26.709311 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:26.709206 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" podStartSLOduration=8.709189315 podStartE2EDuration="8.709189315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:25.871771046 +0000 UTC m=+7.908361749" watchObservedRunningTime="2026-11-03 19:50:26.709189315 +0000 UTC m=+8.745780018" Nov 03 19:50:26.709498 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:26.709423 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-98mpb" podStartSLOduration=3.9583453840000002 podStartE2EDuration="8.709418047s" totalImagesPullingTime="4.751072663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:26.708696889 +0000 UTC m=+8.745287593" watchObservedRunningTime="2026-11-03 19:50:26.709418047 +0000 UTC m=+8.746008748" Nov 03 19:50:27.335864 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.335817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:27.336033 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.335890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:27.336097 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.336031 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:27.336097 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.336092 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:35.336074346 +0000 UTC m=+17.372665050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:27.336209 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.336160 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:27.336209 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.336191 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:35.336182535 +0000 UTC m=+17.372773230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:27.437060 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.437007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:27.437214 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.437163 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:27.437214 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.437182 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:27.437214 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.437195 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:27.437390 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.437265 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:35.437232514 +0000 UTC m=+17.473823210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:27.491098 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.491069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:27.491277 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.491190 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:27.491336 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.491278 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:27.491399 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.491352 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:27.491458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.491408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:27.491506 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:27.491484 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:27.600115 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:27.600082 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" event={"ID":"16949730-542f-4d13-ac31-b546e250b748","Type":"ContainerStarted","Data":"def650ec277b970863c62cf39a97809d7865c88e69ed704460264228bbd44b1c"} Nov 03 19:50:28.180001 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:28.179969 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:28.181264 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:28.180886 2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:28.298122 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:28.297027 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m4dlp" podStartSLOduration=4.848557777 podStartE2EDuration="10.297009386s" totalImagesPullingTime="5.448451609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:26.826015136 +0000 UTC m=+8.862605842" watchObservedRunningTime="2026-11-03 19:50:28.297009386 +0000 UTC m=+10.333600091" Nov 03 19:50:29.173358 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.173337 2574 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 19:50:29.460037 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.459891 2574 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T19:50:29.173785661Z","UUID":"54751e25-8a47-4d49-9625-e40bba1273f0","Handler":null,"Name":"","Endpoint":""} Nov 03 19:50:29.461580 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.461562 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 19:50:29.461682 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.461591 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 19:50:29.491854 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.491827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:29.491973 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:29.491950 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:29.492031 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.492017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:29.492115 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:29.492098 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:29.492174 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.492147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:29.492257 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:29.492220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:29.606749 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.606704 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" event={"ID":"16949730-542f-4d13-ac31-b546e250b748","Type":"ContainerStarted","Data":"8720034f528d9de39a8eb5e1b71c77a82fd8dd45e3e116bda9788b498918b69b"} Nov 03 19:50:29.608564 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.608536 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fbwpl" event={"ID":"1a161ff9-9173-4eb5-ae3d-de5622dc53e1","Type":"ContainerStarted","Data":"4e5170cc5ccacb259c7f8a30c96a1e8f87226da522dd531aa123c16522e38474"} Nov 03 19:50:29.610994 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.610947 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w2c8k" event={"ID":"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b","Type":"ContainerStarted","Data":"7cfa98c2a4724f478bb101789ad3ac2318dce1f1860a9edf2120fbd108deadb5"} Nov 03 19:50:29.611084 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.610995 2574 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:50:29.726305 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.725433 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-fbwpl" podStartSLOduration=3.550500658 podStartE2EDuration="11.725414829s" totalImagesPullingTime="8.174914171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:29.725280326 +0000 UTC m=+11.761871032" watchObservedRunningTime="2026-11-03 19:50:29.725414829 +0000 UTC m=+11.762005534" Nov 03 19:50:29.844863 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:29.844820 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-w2c8k" podStartSLOduration=3.753172826 podStartE2EDuration="11.844805669s" totalImagesPullingTime="8.091632843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:29.844187078 +0000 UTC m=+11.880777785" watchObservedRunningTime="2026-11-03 19:50:29.844805669 +0000 UTC m=+11.881396372" Nov 03 19:50:30.615935 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:30.615704 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="5b1847f6ed8aae90face39f6ad98e6df0e7c0b67bea0f76ced8e395cd84f15bc" exitCode=0 Nov 03 19:50:30.616386 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:30.615761 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"5b1847f6ed8aae90face39f6ad98e6df0e7c0b67bea0f76ced8e395cd84f15bc"} Nov 03 19:50:31.491641 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.491611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:31.491811 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.491618 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:31.491811 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:31.491734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:31.491811 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.491766 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:31.491937 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:31.491836 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:31.491937 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:31.491907 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:31.620556 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.620483 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" event={"ID":"259fae14-47ad-4823-a247-bdccc4ff5cca","Type":"ContainerStarted","Data":"f53327e1497a07673972a36c021a92e16b9112625fe4de48a68f7fb75b5202d8"} Nov 03 19:50:31.622708 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.622204 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6vq2k" event={"ID":"60ba704c-b438-43e8-af83-f2cd1fa4eabf","Type":"ContainerStarted","Data":"9078e9c9de0673b2255803310f8fc0c74c712e659c14aca82d0a6b6353ff8128"} Nov 03 19:50:31.755813 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.755722 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" podStartSLOduration=3.534584276 podStartE2EDuration="13.755704647s" totalImagesPullingTime="10.221120371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:31.75527637 +0000 UTC m=+13.791867074" watchObservedRunningTime="2026-11-03 19:50:31.755704647 +0000 UTC m=+13.792295350" Nov 03 19:50:31.871654 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:31.871607 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6vq2k" podStartSLOduration=5.193254862 podStartE2EDuration="13.871592896s" totalImagesPullingTime="8.678338034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:31.871399901 +0000 UTC m=+13.907990605" watchObservedRunningTime="2026-11-03 19:50:31.871592896 +0000 UTC m=+13.908183599" Nov 03 19:50:32.626979 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:32.626945 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="e906bf8a500fc2195b25cb6e6cccd2a534b168299aa66b8170c5172e7150a84f" exitCode=0 Nov 03 19:50:32.627605 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:32.627045 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"e906bf8a500fc2195b25cb6e6cccd2a534b168299aa66b8170c5172e7150a84f"} Nov 03 19:50:32.629498 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:32.629471 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" event={"ID":"16949730-542f-4d13-ac31-b546e250b748","Type":"ContainerStarted","Data":"eefb2bcda9d0d2235094ab43bef9cafd48f8fca67ff3c5bd81296e526a30158d"} Nov 03 19:50:32.873641 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:32.873582 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" podStartSLOduration=4.083066662 podStartE2EDuration="14.873567956s" totalImagesPullingTime="10.790501294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:32.87322675 +0000 UTC m=+14.909817454" watchObservedRunningTime="2026-11-03 19:50:32.873567956 +0000 UTC m=+14.910158699" Nov 03 19:50:33.491106 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:33.491075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:33.491281 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:33.491153 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:33.491281 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:33.491257 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:33.491357 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:33.491261 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:33.491357 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:33.491312 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:33.491418 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:33.491360 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:34.637527 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:34.637486 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="becd35e17f14a1eada5caa420144dfcca293f7944c4a4786c6bbc98b10516b6e" exitCode=0 Nov 03 19:50:34.638150 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:34.637543 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"becd35e17f14a1eada5caa420144dfcca293f7944c4a4786c6bbc98b10516b6e"} Nov 03 19:50:35.399472 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.399195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:35.399659 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.399517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:35.399659 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.399355 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:35.399659 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.399595 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:50:51.399580196 +0000 UTC m=+33.436170878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:35.399870 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.399669 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:35.399870 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.399734 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret podName:c2ea6d24-ca0a-456a-9e54-b6d34061a066 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:51.399716678 +0000 UTC m=+33.436307376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret") pod "global-pull-secret-syncer-tcj5c" (UID: "c2ea6d24-ca0a-456a-9e54-b6d34061a066") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:35.491663 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.491625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:35.491817 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.491719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:35.491817 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.491740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:35.491921 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.491832 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:35.491921 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.491910 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:35.491988 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.491955 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:35.500713 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:35.500689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:35.500880 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.500863 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:35.500941 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.500888 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:35.500941 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.500901 2574 projected.go:196] Error preparing data for projected volume kube-api-access-bd2wr for pod openshift-network-diagnostics/network-check-target-mcf55: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:35.501025 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:35.500959 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr podName:61ec617a-e595-4e2a-a7c2-20da3189fe6d nodeName:}" failed. No retries permitted until 2026-11-03 19:50:51.500941589 +0000 UTC m=+33.537532285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bd2wr" (UniqueName: "kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr") pod "network-check-target-mcf55" (UID: "61ec617a-e595-4e2a-a7c2-20da3189fe6d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:36.646668 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.646408 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"c689d3d0fc5359c86e4dde900384598cca546254abf68ef53907ca364196c041"} Nov 03 19:50:36.647175 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.646777 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"36a033e001b9626afa7ff9f817cb46de07a6e45088a085dfac754e6ea62a3d63"} Nov 03 19:50:36.647175 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.646849 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"2577da5792efc5e7533a5d25832e9f751c37b4fdebc387f017e49950e9c48e7f"} Nov 03 19:50:36.647175 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.646910 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"8b5b38679c3590f4c432742b60699e02ff1e36170e6ac1b0b14e6a786a361982"} Nov 03 19:50:36.647175 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.646972 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"0cf26cbd6a6de42a049ee9dedf93b2ad3afa63db28448f76c2e5bccf95e85f85"} Nov 03 19:50:36.647175 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:36.647036 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"67d47f3029bfd98d2fa21cc53e684369d8f947d4caaf48358baec723c7ab1531"} Nov 03 19:50:37.491123 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:37.491084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:37.491123 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:37.491108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:37.491402 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:37.491202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:37.491402 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:37.491219 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:37.491402 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:37.491294 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:37.491402 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:37.491354 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:37.650848 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:37.650814 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="7cab26619306f27dac02ee779b2b90808e7976923f41cb8ac38e52b6b21b4986" exitCode=0 Nov 03 19:50:37.651314 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:37.650868 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"7cab26619306f27dac02ee779b2b90808e7976923f41cb8ac38e52b6b21b4986"} Nov 03 19:50:38.655247 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:38.655213 2574 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="21187b140eba3ca196cf3b185698b0e043752c74e889a19f1a5084dcf370508e" exitCode=0 Nov 03 19:50:38.655737 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:38.655271 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerDied","Data":"21187b140eba3ca196cf3b185698b0e043752c74e889a19f1a5084dcf370508e"} Nov 03 19:50:38.661819 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:38.661792 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"ac8216aa7b2b6cdc6d2a25c63d485b3f8ae9d96a20436fa584fee7aa88668d2a"} Nov 03 19:50:39.491300 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:39.491273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:39.491458 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:39.491367 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:39.491458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:39.491277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:39.491458 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:39.491412 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:39.491576 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:39.491488 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:39.491576 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:39.491564 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:39.667083 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:39.667053 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56szs" event={"ID":"d7f2e664-d2c8-4a59-b220-cfa01689c0de","Type":"ContainerStarted","Data":"99243a3feb2741553fa5693f3c526c90d666ac42d8f4818ed9847d1e2360c151"} Nov 03 19:50:39.791131 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:39.791040 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-56szs" podStartSLOduration=9.634304685 podStartE2EDuration="21.791027541s" totalImagesPullingTime="12.156722856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:39.790715364 +0000 UTC m=+21.827306068" watchObservedRunningTime="2026-11-03 19:50:39.791027541 +0000 UTC m=+21.827618245" Nov 03 19:50:40.672902 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:40.672652 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" event={"ID":"a847b75d-17e0-437d-8409-feb11d9a6948","Type":"ContainerStarted","Data":"6077483196b338222513f9595d4decc55fe2bd50e77aa32da0c3539d11f4cf6f"} Nov 03 19:50:40.959000 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:40.957856 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" podStartSLOduration=8.24186031 podStartE2EDuration="22.957837918s" totalImagesPullingTime="14.715977608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:40.956680122 +0000 UTC m=+22.993270828" watchObservedRunningTime="2026-11-03 19:50:40.957837918 +0000 UTC m=+22.994428622" Nov 03 19:50:41.491143 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.491115 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:41.491143 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.491148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:41.491486 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.491156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:41.491486 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:41.491249 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:41.491486 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:41.491358 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:41.491486 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:41.491451 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:41.675570 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.675540 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:41.676037 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.675628 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:41.676037 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.675679 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:41.691423 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.691400 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:41.691559 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:41.691502 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:42.073031 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:42.073003 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:42.073212 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:42.073115 2574 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:50:42.073553 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:42.073538 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:43.066878 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.066848 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcf55"] Nov 03 19:50:43.067386 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.066945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:43.067386 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:43.067029 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:43.069863 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.069838 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcj5c"] Nov 03 19:50:43.069990 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.069924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:43.070039 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:43.070008 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:43.070463 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.070442 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wjbn"] Nov 03 19:50:43.070542 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:43.070528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:43.070624 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:43.070609 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:44.491981 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:44.491951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:44.492363 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:44.491980 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:44.492363 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:44.492101 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:44.492363 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:44.492151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:44.492363 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:44.492214 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:44.492363 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:44.492319 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:46.490870 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:46.490835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:46.490870 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:46.490856 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:46.491394 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:46.490843 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:46.491394 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:46.490973 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:46.491394 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:46.491068 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:46.491394 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:46.491121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:48.491863 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.491836 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:48.492272 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.491869 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:48.492272 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:48.491911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcf55" podUID="61ec617a-e595-4e2a-a7c2-20da3189fe6d" Nov 03 19:50:48.492272 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:48.491973 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tcj5c" podUID="c2ea6d24-ca0a-456a-9e54-b6d34061a066" Nov 03 19:50:48.492272 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.492027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:48.492272 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:48.492119 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wjbn" podUID="03bb2a46-9b02-41fd-991d-119225279dff" Nov 03 19:50:48.761694 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.761533 2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeReady" Nov 03 19:50:48.761796 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.761778 2574 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 19:50:48.940469 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.940436 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-85rll"] Nov 03 19:50:48.942666 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.942651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:48.949454 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.949429 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l598k"] Nov 03 19:50:48.950972 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.950955 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rssgq"] Nov 03 19:50:48.951113 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.951096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l598k" Nov 03 19:50:48.952528 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.952510 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:48.964867 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.964846 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85rll"] Nov 03 19:50:48.976412 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.976391 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l598k"] Nov 03 19:50:48.996412 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.996394 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 19:50:48.996596 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.996580 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 19:50:48.996663 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.996593 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 19:50:48.996663 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.996602 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzphm\"" Nov 03 19:50:48.996663 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:48.996583 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 19:50:49.005169 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005145 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 19:50:49.005399 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005385 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 19:50:49.005471 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005455 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5t9k\"" Nov 03 19:50:49.005746 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005733 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 19:50:49.005798 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005737 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 19:50:49.005798 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005762 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dtr2r\"" Nov 03 19:50:49.005856 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.005800 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 19:50:49.027153 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.027131 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rssgq"] Nov 03 19:50:49.105538 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljfn\" (UniqueName: \"kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.105538 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2mb\" (UniqueName: \"kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.105746 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.105746 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105691 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.105746 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.105896 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.105896 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.105896 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.106001 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.106001 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkpvt\" (UniqueName: \"kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.106001 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.105979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.206475 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.206475 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkpvt\" (UniqueName: \"kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.206475 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljfn\" (UniqueName: \"kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2mb\" (UniqueName: \"kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.206658 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:49.206722 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.206718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:49.706700719 +0000 UTC m=+31.743291415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : configmap "kube-rbac-proxy" not found Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.206921 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.206976 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls podName:7860a5be-91f3-482f-8708-e075bc2f70f1 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:49.706959614 +0000 UTC m=+31.743550314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls") pod "dns-default-l598k" (UID: "7860a5be-91f3-482f-8708-e075bc2f70f1") : secret "dns-default-metrics-tls" not found Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.206991 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.207019 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.206999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.207351 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.207048 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:49.707032211 +0000 UTC m=+31.743622894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.207351 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.207112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.207351 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.207326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.213753 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.211001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.269196 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.269168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkpvt\" (UniqueName: \"kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.269341 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.269220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2mb\" (UniqueName: \"kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.269341 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.269227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljfn\" (UniqueName: \"kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.524315 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.524288 2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-rmw54"] Nov 03 19:50:49.526454 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.526439 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.565403 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.565370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:49.580395 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.580369 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 03 19:50:49.580502 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.580450 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 03 19:50:49.580863 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.580843 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 03 19:50:49.580951 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.580851 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 03 19:50:49.580951 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.580890 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-x67tr\"" Nov 03 19:50:49.584971 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.584949 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-rmw54"] Nov 03 19:50:49.610457 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.610426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5lc6\" (UniqueName: \"kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.610620 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.610486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.610670 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.610629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.711878 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.711854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.711878 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.711882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5lc6\" (UniqueName: \"kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.711911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.711933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.711962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.711976 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.712035 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:50.71201987 +0000 UTC m=+32.748610585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : configmap "kube-rbac-proxy" not found Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.712039 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.712041 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.712074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.712083 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:50.712068808 +0000 UTC m=+32.748659492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.712099 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:49.712105 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls podName:7860a5be-91f3-482f-8708-e075bc2f70f1 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:50.712096832 +0000 UTC m=+32.748687514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls") pod "dns-default-l598k" (UID: "7860a5be-91f3-482f-8708-e075bc2f70f1") : secret "dns-default-metrics-tls" not found Nov 03 19:50:49.712834 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.712811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.714275 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.714259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.773426 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.773406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5lc6\" (UniqueName: \"kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.837127 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.837075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:49.951095 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:49.951070 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rssgq"] Nov 03 19:50:49.953510 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:49.953483 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c7b9d9_b82d_4ce8_ab14_cf39ed8221ef.slice/crio-676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9 WatchSource:0}: Error finding container 676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9: Status 404 returned error can't find the container with id 676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9 Nov 03 19:50:50.203361 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.203292 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-rmw54"] Nov 03 19:50:50.206080 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:50.206055 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8a6aeb_8153_4a2b_a72c_7dbb24b0ee37.slice/crio-77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee WatchSource:0}: Error finding container 77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee: Status 404 returned error can't find the container with id 77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee Nov 03 19:50:50.491633 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.491605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:50.491633 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.491628 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:50.491828 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.491636 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:50.548998 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.548976 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 19:50:50.549557 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.549532 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-926lf\"" Nov 03 19:50:50.549557 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.549533 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 19:50:50.549686 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.549568 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d855x\"" Nov 03 19:50:50.549686 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.549533 2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9gdsm\"" Nov 03 19:50:50.550905 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.550892 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 19:50:50.550963 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.550953 2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 19:50:50.694268 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.694221 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" event={"ID":"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37","Type":"ContainerStarted","Data":"77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee"} Nov 03 19:50:50.695348 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.695314 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rssgq" event={"ID":"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef","Type":"ContainerStarted","Data":"676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9"} Nov 03 19:50:50.718688 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.718659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:50.718814 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.718708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:50.718814 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:50.718735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:50.718814 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718775 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:50.718928 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718828 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:50.718928 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718828 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:50.718928 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718832 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:52.718818385 +0000 UTC m=+34.755409068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : configmap "kube-rbac-proxy" not found Nov 03 19:50:50.718928 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:52.718868294 +0000 UTC m=+34.755458980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:50.718928 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:50.718900 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls podName:7860a5be-91f3-482f-8708-e075bc2f70f1 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:52.718892419 +0000 UTC m=+34.755483104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls") pod "dns-default-l598k" (UID: "7860a5be-91f3-482f-8708-e075bc2f70f1") : secret "dns-default-metrics-tls" not found Nov 03 19:50:51.425949 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.425911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:51.426109 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.426018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:51.426171 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:51.426148 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 19:50:51.426205 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:51.426199 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs podName:03bb2a46-9b02-41fd-991d-119225279dff nodeName:}" failed. No retries permitted until 2026-11-03 19:51:23.426186847 +0000 UTC m=+65.462777529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs") pod "network-metrics-daemon-2wjbn" (UID: "03bb2a46-9b02-41fd-991d-119225279dff") : secret "metrics-daemon-secret" not found Nov 03 19:50:51.429182 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.429160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:51.526946 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.526907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:51.529982 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.529958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:51.707974 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.707912 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:51.713220 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:51.713146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:52.105444 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.105419 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tcj5c"] Nov 03 19:50:52.107824 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:52.107528 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ea6d24_ca0a_456a_9e54_b6d34061a066.slice/crio-f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c WatchSource:0}: Error finding container f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c: Status 404 returned error can't find the container with id f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c Nov 03 19:50:52.155452 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.153842 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcf55"] Nov 03 19:50:52.157126 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:52.157017 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ec617a_e595_4e2a_a7c2_20da3189fe6d.slice/crio-80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea WatchSource:0}: Error finding container 80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea: Status 404 returned error can't find the container with id 80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea Nov 03 19:50:52.597791 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.597756 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-98mpb_7d2c4acc-8137-41ae-b516-4295e9ba1556/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:52.674073 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.674035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fbwpl_1a161ff9-9173-4eb5-ae3d-de5622dc53e1/dns-node-resolver/0.log" Nov 03 19:50:52.702669 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.702638 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcf55" event={"ID":"61ec617a-e595-4e2a-a7c2-20da3189fe6d","Type":"ContainerStarted","Data":"80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea"} Nov 03 19:50:52.704054 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.704025 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tcj5c" event={"ID":"c2ea6d24-ca0a-456a-9e54-b6d34061a066","Type":"ContainerStarted","Data":"f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c"} Nov 03 19:50:52.737530 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.737504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.737538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:52.737557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737638 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737669 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737682 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.737694038 +0000 UTC m=+38.774284720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : configmap "kube-rbac-proxy" not found Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737738 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls podName:7860a5be-91f3-482f-8708-e075bc2f70f1 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.737721342 +0000 UTC m=+38.774312040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls") pod "dns-default-l598k" (UID: "7860a5be-91f3-482f-8708-e075bc2f70f1") : secret "dns-default-metrics-tls" not found Nov 03 19:50:52.737952 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:52.737758 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.73774782 +0000 UTC m=+38.774338507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:53.709580 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:53.709540 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" event={"ID":"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37","Type":"ContainerStarted","Data":"850dd14333c2b4f912b3a5eba634c284875fb3f52a9fd0c33792bcfd6ea54f64"} Nov 03 19:50:53.793798 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:53.793772 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m4dlp_c7880dce-853f-4193-a6c2-0a3f34fa5045/node-ca/0.log" Nov 03 19:50:53.850297 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:53.850192 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" podStartSLOduration=1.994449222 podStartE2EDuration="4.850179194s" totalImagesPullingTime="2.855729972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:53.849439687 +0000 UTC m=+35.886030392" watchObservedRunningTime="2026-11-03 19:50:53.850179194 +0000 UTC m=+35.886769897" Nov 03 19:50:54.727362 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:54.727299 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rssgq" event={"ID":"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef","Type":"ContainerStarted","Data":"8f43fdfd060354265c0d6dc009051fcb535532937f76f25aa1a20028d3cd0bbc"} Nov 03 19:50:54.873903 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:54.873851 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rssgq" podStartSLOduration=3.054987887 podStartE2EDuration="6.873835105s" totalImagesPullingTime="3.818847218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:54.873286249 +0000 UTC m=+36.909876957" watchObservedRunningTime="2026-11-03 19:50:54.873835105 +0000 UTC m=+36.910425810" Nov 03 19:50:56.734627 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.734584 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcf55" event={"ID":"61ec617a-e595-4e2a-a7c2-20da3189fe6d","Type":"ContainerStarted","Data":"0a4fe1130800bb25b719002592e1b4eae2d520d6840154b16501d6338e190769"} Nov 03 19:50:56.735108 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.734708 2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:56.770252 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.770202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:56.770440 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.770276 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:56.770440 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.770299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:56.770542 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:56.770439 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:56.770542 ip-10-0-134-71 kubenswrapper[2574]: E1103 19:50:56.770488 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls podName:5bd317fd-6ece-4ccc-81fc-50e0534a5377 nodeName:}" failed. No retries permitted until 2026-11-03 19:51:04.7704756 +0000 UTC m=+46.807066296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-85rll" (UID: "5bd317fd-6ece-4ccc-81fc-50e0534a5377") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:56.770942 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.770893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:56.773256 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.773211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:56.852703 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:56.852630 2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mcf55" podStartSLOduration=35.030931832 podStartE2EDuration="38.8526123s" totalImagesPullingTime="3.821680468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:56.852305896 +0000 UTC m=+38.888896603" watchObservedRunningTime="2026-11-03 19:50:56.8526123 +0000 UTC m=+38.889203006" Nov 03 19:50:57.062110 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:57.062030 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l598k" Nov 03 19:50:57.443530 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:57.443384 2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l598k"] Nov 03 19:50:57.446330 ip-10-0-134-71 kubenswrapper[2574]: W1103 19:50:57.446286 2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7860a5be_91f3_482f_8708_e075bc2f70f1.slice/crio-5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48 WatchSource:0}: Error finding container 5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48: Status 404 returned error can't find the container with id 5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48 Nov 03 19:50:57.739116 ip-10-0-134-71 kubenswrapper[2574]: I1103 19:50:57.739077 2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l598k" event={"ID":"7860a5be-91f3-482f-8708-e075bc2f70f1","Type":"ContainerStarted","Data":"5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48"} Nov 03 19:50:58.040161 ip-10-0-134-71 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 19:50:58.053712 ip-10-0-134-71 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 19:50:58.053878 ip-10-0-134-71 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 19:50:58.053927 ip-10-0-134-71 systemd[1]: kubelet.service: Consumed 2.332s CPU time. Nov 03 19:50:58.069736 ip-10-0-134-71 systemd[1]: Starting Kubernetes Kubelet... Nov 03 19:50:58.129438 ip-10-0-134-71 kubenswrapper[4456]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:58.129438 ip-10-0-134-71 kubenswrapper[4456]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 19:50:58.129438 ip-10-0-134-71 kubenswrapper[4456]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:58.129438 ip-10-0-134-71 kubenswrapper[4456]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132495 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132575 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132579 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132582 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132585 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.132579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132588 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132591 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132594 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132597 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132599 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132602 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132606 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132611 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132615 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132618 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132621 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132624 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132627 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132630 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132632 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132635 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132638 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132641 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132643 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.132812 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132645 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132648 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132650 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132653 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132655 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132659 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132661 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132664 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132666 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132669 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132672 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132674 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132676 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132679 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132682 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132685 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132687 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132690 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132692 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.133355 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132695 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132697 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132700 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132703 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132706 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132708 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132714 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132717 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132721 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132725 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132728 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132730 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132733 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132736 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132738 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132741 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132744 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132747 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132749 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132752 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.133829 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132754 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132757 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132760 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132762 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132765 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132767 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132770 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132772 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132775 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132777 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132779 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132782 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132785 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132787 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132789 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132792 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132795 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132798 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132802 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132805 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.134334 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132808 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132811 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132814 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132816 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132819 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132821 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132825 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132828 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132830 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132833 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132836 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132838 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132841 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132843 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132846 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132848 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132851 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132853 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132856 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132858 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.134821 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132861 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132863 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.132866 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133690 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133699 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133703 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133706 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133709 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133714 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133718 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133722 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133725 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133727 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133731 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133735 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133738 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133741 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133744 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.135331 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133746 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133749 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133752 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133754 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133757 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133759 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133762 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133764 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133767 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133769 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133772 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133774 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133777 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133779 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133782 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133784 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133787 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133789 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133792 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133794 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.135766 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133797 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133800 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133803 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133805 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133808 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133811 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133813 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133816 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133819 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133822 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133824 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133827 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133829 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133832 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133834 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133837 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133840 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133842 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133845 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.136264 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133847 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133850 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133852 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133855 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133857 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133860 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133862 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133865 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133867 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133870 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133873 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133876 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133878 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133881 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133884 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133886 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133889 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133891 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133893 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133896 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.136736 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133898 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133901 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133904 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133906 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133909 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133911 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133914 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133917 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133919 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133922 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133924 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133926 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133929 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133931 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133934 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133936 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133938 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133941 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133943 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.137231 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133946 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133949 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133952 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133955 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133957 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133960 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133962 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133964 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133967 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133969 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133972 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133975 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.133979 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134465 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134470 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134473 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134476 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134479 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134481 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134484 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.137718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134487 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134489 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134492 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134494 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134496 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134499 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134502 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134505 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134507 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134510 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134513 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134517 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134520 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134522 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134525 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134527 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134530 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134532 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134535 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134537 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.138250 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134539 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134542 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134544 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134546 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134549 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134551 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134554 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134556 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134559 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134561 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134564 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134566 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134569 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134571 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134574 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134576 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134578 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134581 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134584 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134586 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.138754 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134588 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134592 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134596 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134600 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134603 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134605 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134608 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134610 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134613 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134615 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134617 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134620 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134622 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134624 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134627 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134630 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134632 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134635 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134637 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.139252 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134640 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134642 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134646 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134648 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134651 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134653 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134656 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134659 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134662 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134664 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134667 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134669 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134672 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134674 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134676 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134679 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134683 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134685 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134687 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134690 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.139723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134693 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134695 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134697 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134700 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134702 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134705 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134707 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134711 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134718 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134721 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134724 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134727 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134729 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134732 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134734 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134737 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134739 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134742 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134744 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.134747 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.140197 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134856 4456 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134863 4456 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134870 4456 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134875 4456 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134878 4456 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134881 4456 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134885 4456 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134890 4456 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134894 4456 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134897 4456 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134901 4456 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134904 4456 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134907 4456 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134910 4456 flags.go:64] FLAG: --cgroup-root="" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134913 4456 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134916 4456 flags.go:64] FLAG: --client-ca-file="" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134919 4456 flags.go:64] FLAG: --cloud-provider="external" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134922 4456 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134926 4456 flags.go:64] FLAG: --cluster-domain="" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134929 4456 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134933 4456 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134936 4456 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134939 4456 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134947 4456 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 19:50:58.140686 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134950 4456 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134953 4456 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134956 4456 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134959 4456 flags.go:64] FLAG: --contention-profiling="false" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134963 4456 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134966 4456 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134969 4456 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134972 4456 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134977 4456 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134980 4456 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134983 4456 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134985 4456 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134988 4456 flags.go:64] FLAG: --enable-server="true" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134991 4456 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134996 4456 flags.go:64] FLAG: --event-burst="100" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.134999 4456 flags.go:64] FLAG: --event-qps="50" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135003 4456 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135007 4456 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135009 4456 flags.go:64] FLAG: --eviction-hard="" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135013 4456 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135016 4456 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135019 4456 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135022 4456 flags.go:64] FLAG: --eviction-soft="" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135025 4456 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135028 4456 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 19:50:58.141279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135031 4456 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135033 4456 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135036 4456 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135040 4456 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135043 4456 flags.go:64] FLAG: --feature-gates="" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135047 4456 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135050 4456 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135054 4456 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135057 4456 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135059 4456 flags.go:64] FLAG: --healthz-port="10248" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135062 4456 flags.go:64] FLAG: --help="false" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135065 4456 flags.go:64] FLAG: --hostname-override="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135069 4456 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135072 4456 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135075 4456 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135078 4456 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135081 4456 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135084 4456 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135087 4456 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135090 4456 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135092 4456 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135095 4456 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135098 4456 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135102 4456 flags.go:64] FLAG: --kube-reserved="" Nov 03 19:50:58.142060 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135105 4456 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135108 4456 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135111 4456 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135113 4456 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135117 4456 flags.go:64] FLAG: --lock-file="" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135119 4456 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135122 4456 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135125 4456 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135130 4456 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135133 4456 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135136 4456 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135140 4456 flags.go:64] FLAG: --logging-format="text" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135143 4456 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135147 4456 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135149 4456 flags.go:64] FLAG: --manifest-url="" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135152 4456 flags.go:64] FLAG: --manifest-url-header="" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135157 4456 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135160 4456 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135164 4456 flags.go:64] FLAG: --max-pods="110" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135167 4456 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135170 4456 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135173 4456 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135176 4456 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135179 4456 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135181 4456 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 19:50:58.142678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135184 4456 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135191 4456 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135194 4456 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135197 4456 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135200 4456 flags.go:64] FLAG: --pod-cidr="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135203 4456 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135207 4456 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135210 4456 flags.go:64] FLAG: --pods-per-core="0" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135212 4456 flags.go:64] FLAG: --port="10250" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135215 4456 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135218 4456 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0ea55a948fc3dee35" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135221 4456 flags.go:64] FLAG: --qos-reserved="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135224 4456 flags.go:64] FLAG: --read-only-port="10255" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135227 4456 flags.go:64] FLAG: --register-node="true" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135229 4456 flags.go:64] FLAG: --register-with-taints="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135246 4456 flags.go:64] FLAG: --registry-burst="10" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135249 4456 flags.go:64] FLAG: --registry-qps="5" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135252 4456 flags.go:64] FLAG: --reserved-cpus="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135256 4456 flags.go:64] FLAG: --reserved-memory="" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135260 4456 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135263 4456 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135266 4456 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135269 4456 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135272 4456 flags.go:64] FLAG: --runonce="false" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135275 4456 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135277 4456 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135280 4456 flags.go:64] FLAG: --seccomp-default="false" Nov 03 19:50:58.143300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135283 4456 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135285 4456 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135295 4456 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135298 4456 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135301 4456 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135303 4456 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135306 4456 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135309 4456 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135312 4456 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135315 4456 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135317 4456 flags.go:64] FLAG: --system-cgroups="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135321 4456 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135326 4456 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135329 4456 flags.go:64] FLAG: --tls-cert-file="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135332 4456 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135336 4456 flags.go:64] FLAG: --tls-min-version="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135339 4456 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135342 4456 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135345 4456 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135348 4456 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135351 4456 flags.go:64] FLAG: --v="2" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135355 4456 flags.go:64] FLAG: --version="false" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135359 4456 flags.go:64] FLAG: --vmodule="" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135364 4456 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 19:50:58.143978 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135367 4456 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135503 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135509 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135513 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135516 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135519 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135522 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135525 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135528 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135530 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135533 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135542 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135544 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135547 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135549 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135552 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135555 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135558 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135560 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.144583 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135564 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135566 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135569 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135571 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135574 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135577 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135579 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135582 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135585 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135587 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135590 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135593 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135597 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135600 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135602 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135605 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135607 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135610 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135612 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.145184 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135616 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135620 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135624 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135626 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135629 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135632 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135635 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135638 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135640 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135643 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135645 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135648 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135650 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135653 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135656 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135658 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135661 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135663 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135666 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135668 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.145959 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135671 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135673 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135675 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135678 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135680 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135684 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135687 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135689 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135692 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135694 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135697 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135699 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135702 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135704 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135707 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135709 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135712 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135715 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135717 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135720 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.146518 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135723 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135725 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135728 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135730 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135733 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135735 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135738 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135740 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135743 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135746 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135748 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135751 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135753 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135755 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135758 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135760 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135763 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135767 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135770 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.147062 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135772 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135775 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135778 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135780 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135783 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135785 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135788 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135790 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135793 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135796 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.135820 4456 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135855 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135860 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135863 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135866 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135868 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.147755 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135871 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135873 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135876 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135878 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135881 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135883 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135886 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135888 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135891 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135893 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135896 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135899 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135902 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135905 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135907 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135911 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135913 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135916 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135918 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135921 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.148389 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135923 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135926 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135928 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135931 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135933 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135936 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135938 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135940 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135943 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135945 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135949 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135951 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135954 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135956 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135959 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135961 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135963 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135967 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135969 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.148871 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135972 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135975 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135977 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135980 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135982 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135986 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135989 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135992 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135996 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.135998 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136001 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136003 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136006 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136009 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136011 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136014 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136017 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136019 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136022 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.149471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136024 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136027 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136029 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136031 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136034 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136037 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136039 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136042 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136044 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136046 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136049 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136051 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136054 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136056 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136059 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136062 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136064 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136067 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136070 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136073 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.149982 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136075 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136077 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136080 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136082 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136085 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136088 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136091 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136094 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136097 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136099 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136102 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136104 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136107 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136109 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136112 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136115 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136117 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136120 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136123 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.150514 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136126 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136129 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136131 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.136134 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.140272 4456 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.140285 4456 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.140302 4456 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.140306 4456 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140361 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140365 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140368 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140371 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140374 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140376 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140378 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140381 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140383 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140386 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140388 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.150965 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140391 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140393 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140396 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140398 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140401 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140404 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140406 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140409 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140412 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140415 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140417 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140420 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140424 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140427 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140431 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140434 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140437 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140440 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140443 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.151464 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140446 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140448 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140451 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140454 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140456 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140459 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140461 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140463 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140466 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140469 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140471 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140474 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140476 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140479 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140482 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140484 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140487 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140489 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140492 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.151912 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140494 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140497 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140500 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140502 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140505 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140507 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140510 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140512 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140515 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140517 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140520 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140522 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140524 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140527 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140530 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140532 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140534 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140537 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140539 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140541 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.152504 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140544 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140548 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140552 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140555 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140558 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140561 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140563 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140566 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140568 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140570 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140573 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140575 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140578 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140581 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140583 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140586 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140588 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140591 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140593 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.152972 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140596 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140598 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140601 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140603 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140606 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140608 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140611 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140613 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140616 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140618 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140621 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140623 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140625 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140628 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140630 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140633 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140635 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.153451 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140638 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.140665 4456 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140809 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140813 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140816 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140819 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140822 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140824 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140827 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140829 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140831 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140834 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140836 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140839 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140841 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.153863 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140843 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140846 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140849 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140852 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140854 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140856 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140859 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140861 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140864 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140866 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140869 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140871 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140873 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140876 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140878 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140881 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140883 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140886 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140888 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.154227 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140890 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140893 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140895 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140898 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140900 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140903 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140905 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140907 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140911 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140915 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140917 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140920 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140922 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140925 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140927 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140929 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140932 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140935 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140937 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.154725 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140939 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140942 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140944 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140946 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140949 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140951 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140953 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140956 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140961 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140963 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140966 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140968 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140971 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140973 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140976 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140978 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140981 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140983 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140985 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140988 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.155203 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140990 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140993 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140996 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.140998 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141000 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141003 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141005 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141008 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141011 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141013 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141016 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141019 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141023 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141026 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141029 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141031 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141034 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141036 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141039 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141041 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.155723 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141045 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141048 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141050 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141053 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141055 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141058 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141061 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141063 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141066 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141068 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141071 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141073 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141076 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141078 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141080 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.141102 4456 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:58.156212 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141130 4456 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141135 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141138 4456 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141141 4456 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141144 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141147 4456 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141150 4456 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141158 4456 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141161 4456 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141164 4456 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141166 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141169 4456 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141171 4456 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141174 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141177 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141179 4456 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141182 4456 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141186 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141189 4456 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:58.156612 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141192 4456 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141194 4456 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141197 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141199 4456 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141201 4456 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141204 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141206 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141209 4456 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141211 4456 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141214 4456 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141216 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141219 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141222 4456 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141226 4456 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141229 4456 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141232 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141253 4456 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141257 4456 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141260 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:58.157058 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141264 4456 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141270 4456 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141275 4456 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141278 4456 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141280 4456 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141283 4456 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141286 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141288 4456 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141291 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141294 4456 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141296 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141300 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141302 4456 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141305 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141307 4456 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141310 4456 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141312 4456 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141315 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141317 4456 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141319 4456 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:58.157642 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141322 4456 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141337 4456 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141340 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141342 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141345 4456 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141347 4456 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141350 4456 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141353 4456 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141356 4456 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141358 4456 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141361 4456 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141364 4456 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141366 4456 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141369 4456 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141372 4456 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141375 4456 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141380 4456 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141383 4456 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141386 4456 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141389 4456 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:58.158102 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141391 4456 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141394 4456 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141397 4456 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141403 4456 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141405 4456 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141408 4456 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141411 4456 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141413 4456 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141415 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141420 4456 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141422 4456 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141425 4456 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141427 4456 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141429 4456 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141432 4456 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141434 4456 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141437 4456 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141439 4456 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141442 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141445 4456 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:58.158617 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141447 4456 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141450 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141453 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141455 4456 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141457 4456 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141460 4456 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141462 4456 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:50:58.141465 4456 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.141514 4456 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142461 4456 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142514 4456 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142703 4456 server.go:1014] "Starting client certificate rotation" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142844 4456 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142907 4456 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:45:18 +0000 UTC" deadline="2028-05-05 10:11:50.00712793 +0000 UTC" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.142941 4456 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13166h20m51.864189612s" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.143257 4456 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:58.159199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.144261 4456 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:58.159620 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.147349 4456 log.go:25] "Validated CRI v1 runtime API" Nov 03 19:50:58.159620 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.149033 4456 log.go:25] "Validated CRI v1 image API" Nov 03 19:50:58.159620 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.149790 4456 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 19:50:58.159620 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.151210 4456 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 dc86330e-7710-451a-b020-3e93fe20729f:/dev/nvme0n1p3 df59d6f4-9e2a-4b46-baba-ad0e2272110e:/dev/nvme0n1p4] Nov 03 19:50:58.159734 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.151225 4456 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4/userdata/shm major:0 minor:87 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2774a6a33fe6e6684a03e078f783e4263f48eaf57ef572a36d054b8ef8d10985/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2774a6a33fe6e6684a03e078f783e4263f48eaf57ef572a36d054b8ef8d10985/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea/userdata/shm major:0 minor:215 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03bb2a46-9b02-41fd-991d-119225279dff/volumes/kubernetes.io~projected/kube-api-access-95sb9:{mountpoint:/var/lib/kubelet/pods/03bb2a46-9b02-41fd-991d-119225279dff/volumes/kubernetes.io~projected/kube-api-access-95sb9 major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/16949730-542f-4d13-ac31-b546e250b748/volumes/kubernetes.io~projected/kube-api-access-9nq72:{mountpoint:/var/lib/kubelet/pods/16949730-542f-4d13-ac31-b546e250b748/volumes/kubernetes.io~projected/kube-api-access-9nq72 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a161ff9-9173-4eb5-ae3d-de5622dc53e1/volumes/kubernetes.io~projected/kube-api-access-vfrsf:{mountpoint:/var/lib/kubelet/pods/1a161ff9-9173-4eb5-ae3d-de5622dc53e1/volumes/kubernetes.io~projected/kube-api-access-vfrsf major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/tmp major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~projected/kube-api-access-9qc46:{mountpoint:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~projected/kube-api-access-9qc46 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5bd317fd-6ece-4ccc-81fc-50e0534a5377/volumes/kubernetes.io~projected/kube-api-access-md2mb:{mountpoint:/var/lib/kubelet/pods/5bd317fd-6ece-4ccc-81fc-50e0534a5377/volumes/kubernetes.io~projected/kube-api-access-md2mb major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60ba704c-b438-43e8-af83-f2cd1fa4eabf/volumes/kubernetes.io~projected/kube-api-access-xljcg:{mountpoint:/var/lib/kubelet/pods/60ba704c-b438-43e8-af83-f2cd1fa4eabf/volumes/kubernetes.io~projected/kube-api-access-xljcg major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61ec617a-e595-4e2a-a7c2-20da3189fe6d/volumes/kubernetes.io~projected/kube-api-access-bd2wr:{mountpoint:/var/lib/kubelet/pods/61ec617a-e595-4e2a-a7c2-20da3189fe6d/volumes/kubernetes.io~projected/kube-api-access-bd2wr major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~projected/kube-api-access-qljfn:{mountpoint:/var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~projected/kube-api-access-qljfn major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~secret/metrics-tls major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d2c4acc-8137-41ae-b516-4295e9ba1556/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7d2c4acc-8137-41ae-b516-4295e9ba1556/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~projected/kube-api-access-jkpvt:{mountpoint:/var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~projected/kube-api-access-jkpvt major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b/volumes/kubernetes.io~projected/kube-api-access-jsspw:{mountpoint:/var/lib/kubelet/pods/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b/volumes/kubernetes.io~projected/kube-api-access-jsspw major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~projected/kube-api-access-4qsh8:{mountpoint:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~projected/kube-api-access-4qsh8 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~projected/kube-api-access-f5lc6:{mountpoint:/var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~projected/kube-api-access-f5lc6 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~secret/signing-key major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c2ea6d24-ca0a-456a-9e54-b6d34061a066/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c2ea6d24-ca0a-456a-9e54-b6d34061a066/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c7880dce-853f-4193-a6c2-0a3f34fa5045/volumes/kubernetes.io~projected/kube-api-access-jsfw4:{mountpoint:/var/lib/kubelet/pods/c7880dce-853f-4193-a6c2-0a3f34fa5045/volumes/kubernetes.io~projected/kube-api-access-jsfw4 major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d7f2e664-d2c8-4a59-b220-cfa01689c0de/volumes/kubernetes.io~projected/kube-api-access-trsc2:{mountpoint:/var/lib/kubelet/pods/d7f2e664-d2c8-4a59-b220-cfa01689c0de/volumes/kubernetes.io~projected/kube-api-access-trsc2 major:0 minor:54 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/abb12a343ca9e581d97cc3d2f9f0584f4308ea8ec4ea6fb4f94b2e0fdba338b4/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/23f059eefa814510cff6fb1b535ca5525ab2db24bf25c70ebef3544e133e0ebc/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/07af4f91f632c51511addb4eb27d2f29a21a4f7db1f5909189b6fd2a38811b0a/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/96b6d42a5263d199b70a2509a971cd56566bb1d2b412ed80c36347788c61004a/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7054650518a5e67e4e43f241f074ce20c8fef08310e0de69b20866c562a72fc2/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/14dd027a158c4a6d65da057dfb83dd3d51a521338c62dcd53a7f6ab86ae7822c/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/75d1b99416dff524ee084825b0749671792c917b31799a20f6d3a0b82f8221d0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/e95600c3fb9de0199e2a9740f07addedec21b0a82cc14fc6726f79023357f558/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/e1de15a71994fffbfe11d20ce86eb76b1995502e65c4711a987c0b932bb59c7b/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-131:{mountpoint:/var/lib/containers/storage/overlay/b45d2b425a1999655fb342c896a5afba9cd2aea7a17bfba005f4b9129077f355/merged major:0 minor:131 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/bdca598830d506a816872fe8f98790c0c9e41c245503bcb0d4c5ee7298d0750a/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/7a4109576e127b4b12131b60269425cafde71ce29966a48ddc7048913db07b46/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/9661023392e819848066d60cb6e966f3ec9662997a658b213d1420014312d093/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/fe5c704ae4b702da8229e4b855325bfe2ea752fa7735524bac1a6a258342a43a/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/536f24178ba0876f247860379c19ebd76a2b03eec854c2dd2ef101fa99c7f6ae/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ca5e323878a33f26b7fb17e31bd058c0b57d695a476024424e32c182d107e3b6/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/65bdd903736a32a1ef85fddfc43f8a39d6d64f70415306e273ad7ce995e4a422/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/fb8c2ed9d4f46a852ba85f1c163b2d810f4b135a5f2c8db0df1268e61955852e/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/840ddffe4bdd8806ffde9dab0c61199a51bef085d8d184e9b863efd1d7265585/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e417f8afa6833dec39411465685cbd734fb7b372586850246ba3f89667cdad5f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/2ad36d8d23a4e74e2b97d5e9dd92caefa0edf637849ffbbf6a431ec32d727063/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-209:{mountpoint:/var/lib/containers/storage/overlay/447d59240e0ab9dd49265c10d8dfe4f44eab67acb4b47b5eb625bedc4f0f2b2c/merged major:0 minor:209 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/fbcdb7cbe6fdb862a9aa47e6a89846a0276f3e1bf41439d995867191c0e55516/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/2c1f9188960161c78a21cdca9921ae786aa53b44472721807b3e76bed8a53313/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/3d4d9d59530232cdbdbc4f402b12dfc783ebfd28df38a2924013a5fbb5f6457d/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-223:{mountpoint:/var/lib/containers/storage/overlay/323efad7888982e68385379e4f083196d9303edcc1d0e6019233702e73baf9c4/merged major:0 minor:223 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/8b4a551176fe1af44615643dd0c6f2f6a257b3c9b0e2124118bf171b145f35f5/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/d8067df6cc531eee799027b874cd4d336353f25df359749e712455b4159200d0/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/df1f879d672d34006c0e2ff320d222751f6ba1ede932f38556698e0b0903bb81/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/7c56b009d762aa8673d5e39ceb8a44897e1dd076d0fa692f9a448e462df8ef3c/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/52f901d40b9420b2bfdb73deb51a12eaef096efd798122e7edc0a1712b74bd2d/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/a30a6b4a7b8ff1471527339309c52aa8602a51a767c8410b6cc77e3b214728e7/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/6443416ed89c2e9113a9a71a56a863573549a22a2d02bde548145802595c81f5/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/f99fcdcecd45fb750a73868de101e645342557aedd83c42789592e0a8409b0d6/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/273cd7c55389a75463cd8b0ba54b926bb22ce243f590e734a5f95b50c743ce6a/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/5a1d1b041f860068dfbbb18d0a9db6962adb309fe8eb9197f74dd57cf3cf366e/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/3728baf1dafb0131caa576847f04406ed8e25793c3e94ea1b87b56634fc389f3/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-91:{mountpoint:/var/lib/containers/storage/overlay/2dd2936c89b3f9fd14df642594e567036602124e833af2ed2d83abbb9d8de235/merged major:0 minor:91 fsType:overlay blockSize:0} overlay_0-93:{mountpoint:/var/lib/containers/storage/overlay/b0b2dea4455db2e484ae015fa32170ed4b5a0b5e18304a4949a88789012eef5d/merged major:0 minor:93 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/74e5b50df354f6cdb1579a1a560b1ce22bb9e6e2e7b765164cd8e90e5352361e/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.157599 4456 manager.go:217] Machine: {Timestamp:2026-11-03 19:50:58.157108927 +0000 UTC m=+0.057210725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3146624 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aadba338d4805402cca6e84d6b9aa SystemUUID:ec2aadba-338d-4805-402c-ca6e84d6b9aa BootID:9b468d85-9aca-4e8e-9293-184f519c1294 Filesystems:[{Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c2ea6d24-ca0a-456a-9e54-b6d34061a066/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:213 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/61ec617a-e595-4e2a-a7c2-20da3189fe6d/volumes/kubernetes.io~projected/kube-api-access-bd2wr DeviceMajor:0 DeviceMinor:214 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1a161ff9-9173-4eb5-ae3d-de5622dc53e1/volumes/kubernetes.io~projected/kube-api-access-vfrsf DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0db2aa6024b4f65008f59cb7db3b8b6482285f1fb351f9a45a4925242e889598/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-93 DeviceMajor:0 DeviceMinor:93 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~projected/kube-api-access-jkpvt DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5bd317fd-6ece-4ccc-81fc-50e0534a5377/volumes/kubernetes.io~projected/kube-api-access-md2mb DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:237 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/c7880dce-853f-4193-a6c2-0a3f34fa5045/volumes/kubernetes.io~projected/kube-api-access-jsfw4 DeviceMajor:0 DeviceMinor:52 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/16949730-542f-4d13-ac31-b546e250b748/volumes/kubernetes.io~projected/kube-api-access-9nq72 DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eed06ab69de852170c9ba6e8ec4d7c3bdf30c65506848c1f3f35a5ffabdb73c7/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d0fd2f7d75853cf65a22c4f2c00188b364573f653224ed2a99e07b8fc5191318/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2774a6a33fe6e6684a03e078f783e4263f48eaf57ef572a36d054b8ef8d10985/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d7f2e664-d2c8-4a59-b220-cfa01689c0de/volumes/kubernetes.io~projected/kube-api-access-trsc2 DeviceMajor:0 DeviceMinor:54 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5a0c245cd915b3df06822bba1f2a19e4444e4bda665a69178fb3c547b3366f48/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-223 DeviceMajor:0 DeviceMinor:223 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/40766739ede82afd6ec1a6114dc6425d05ad8476ba90ad266bd5062931fc9062/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/153b6e1f5fdf38c8bebfbd89eebc8954b255d6bd55314586dfc075db5fa8902b/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-209 DeviceMajor:0 DeviceMinor:209 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f70750fc3682d54f1ff41ad03f6cda21208bffc956db39c8f813be5c54024f4/userdata/shm DeviceMajor:0 DeviceMinor:87 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80206b4ef95e1afea7ccd6a3179d0842dbead57bc5b54febd24ec6be6a7307ea/userdata/shm DeviceMajor:0 DeviceMinor:215 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b/volumes/kubernetes.io~projected/kube-api-access-jsspw DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2de686e1d9c24695ab922a27714f50885cc88a2126ade197ed0f4ce96f077673/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:205 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f39ca3534e2c538807fe829c138c92313a69a97208826fc06fceb9da5529e26c/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:47 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~projected/kube-api-access-9qc46 DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-131 DeviceMajor:0 DeviceMinor:131 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/676ad5f25d3afccda37b86a7beaf180528289a4390f64a930f68763dd571a7a9/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/7d2c4acc-8137-41ae-b516-4295e9ba1556/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60ba704c-b438-43e8-af83-f2cd1fa4eabf/volumes/kubernetes.io~projected/kube-api-access-xljcg DeviceMajor:0 DeviceMinor:53 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~projected/kube-api-access-4qsh8 DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-91 DeviceMajor:0 DeviceMinor:91 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37/volumes/kubernetes.io~projected/kube-api-access-f5lc6 DeviceMajor:0 DeviceMinor:206 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/03bb2a46-9b02-41fd-991d-119225279dff/volumes/kubernetes.io~projected/kube-api-access-95sb9 DeviceMajor:0 DeviceMinor:51 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7860a5be-91f3-482f-8708-e075bc2f70f1/volumes/kubernetes.io~projected/kube-api-access-qljfn DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77caa84b26f185dc57f8d6e08440efcb5b24688882e0c4998ef409eaf032a4ee/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a847b75d-17e0-437d-8409-feb11d9a6948/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:48 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/259fae14-47ad-4823-a247-bdccc4ff5cca/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:49 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:5a0c245cd915b3d MacAddress:be:78:ec:a1:62:5b Speed:10000 Mtu:8901} {Name:676ad5f25d3afcc MacAddress:82:4f:c9:62:d7:ff Speed:10000 Mtu:8901} {Name:77caa84b26f185d MacAddress:c2:d7:20:70:05:fd Speed:10000 Mtu:8901} {Name:80206b4ef95e1af MacAddress:a6:d7:4b:8d:f7:9b Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:71:54:51:24:e1 Speed:0 Mtu:9001} {Name:br-int MacAddress:de:94:70:4d:28:7e Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:71:54:51:24:e1 Speed:0 Mtu:9001} {Name:f39ca3534e2c538 MacAddress:6a:a5:23:75:3d:3a Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:12:f8:cf:4b:1a:a4 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:26:12:30:d0:5a:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.157852 4456 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.157894 4456 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158174 4456 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158199 4456 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-71.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158361 4456 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158370 4456 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158380 4456 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158399 4456 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158461 4456 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158613 4456 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158728 4456 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158765 4456 kubelet.go:493] "Attempting to sync node with API server" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158776 4456 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158787 4456 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158795 4456 kubelet.go:405] "Adding apiserver pod source" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.158802 4456 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.159739 4456 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 19:50:58.159879 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.159757 4456 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:58.160736 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.160530 4456 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 19:50:58.169149 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169134 4456 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 19:50:58.169149 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169148 4456 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:58.169364 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169265 4456 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 19:50:58.169469 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169458 4456 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 19:50:58.169512 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169488 4456 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 19:50:58.169583 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169574 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169598 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169605 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169611 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169617 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169623 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 19:50:58.169626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169628 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169634 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169641 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169646 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169655 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169664 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169688 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 19:50:58.169795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.169695 4456 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 19:50:58.173179 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.172895 4456 server.go:1263] "Started kubelet" Nov 03 19:50:58.173179 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.173006 4456 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 19:50:58.173459 ip-10-0-134-71 systemd[1]: Started Kubernetes Kubelet. Nov 03 19:50:58.173627 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.173363 4456 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 19:50:58.173627 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.173519 4456 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 19:50:58.173866 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.173848 4456 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 19:50:58.174481 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.174461 4456 server.go:317] "Adding debug handlers to kubelet server" Nov 03 19:50:58.175912 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.175897 4456 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 19:50:58.176002 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.175921 4456 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:58.176108 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.176053 4456 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" Nov 03 19:50:58.176206 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.176169 4456 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:19 +0000 UTC" deadline="2028-04-06 05:22:47.905910449 +0000 UTC" Nov 03 19:50:58.176296 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.176208 4456 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12465h31m49.729706044s" Nov 03 19:50:58.176759 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.176743 4456 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 19:50:58.176944 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.176844 4456 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 19:50:58.176944 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.176856 4456 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 19:50:58.178340 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178324 4456 factory.go:55] Registering systemd factory Nov 03 19:50:58.178340 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178342 4456 factory.go:223] Registration of the systemd container factory successfully Nov 03 19:50:58.178580 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178565 4456 factory.go:153] Registering CRI-O factory Nov 03 19:50:58.178580 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178586 4456 factory.go:223] Registration of the crio container factory successfully Nov 03 19:50:58.178804 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178767 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7f2e664-d2c8-4a59-b220-cfa01689c0de" volumeName="kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2" seLinuxMountContext="" Nov 03 19:50:58.178804 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178795 4456 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 19:50:58.178804 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178798 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61ec617a-e595-4e2a-a7c2-20da3189fe6d" volumeName="kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr" seLinuxMountContext="" Nov 03 19:50:58.178954 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178821 4456 factory.go:103] Registering Raw factory Nov 03 19:50:58.178954 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178825 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7860a5be-91f3-482f-8708-e075bc2f70f1" volumeName="kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume" seLinuxMountContext="" Nov 03 19:50:58.179181 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.179144 4456 manager.go:1199] Started watching for new ooms in manager Nov 03 19:50:58.179611 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.179597 4456 manager.go:319] Starting recovery of all containers Nov 03 19:50:58.180493 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.178840 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7860a5be-91f3-482f-8708-e075bc2f70f1" volumeName="kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls" seLinuxMountContext="" Nov 03 19:50:58.180580 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180524 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="16949730-542f-4d13-ac31-b546e250b748" volumeName="kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72" seLinuxMountContext="" Nov 03 19:50:58.180629 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180579 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a847b75d-17e0-437d-8409-feb11d9a6948" volumeName="kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib" seLinuxMountContext="" Nov 03 19:50:58.180629 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180606 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a847b75d-17e0-437d-8409-feb11d9a6948" volumeName="kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config" seLinuxMountContext="" Nov 03 19:50:58.180728 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180634 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7880dce-853f-4193-a6c2-0a3f34fa5045" volumeName="kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca" seLinuxMountContext="" Nov 03 19:50:58.180728 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180656 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7f2e664-d2c8-4a59-b220-cfa01689c0de" volumeName="kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 19:50:58.180728 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180669 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="259fae14-47ad-4823-a247-bdccc4ff5cca" volumeName="kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp" seLinuxMountContext="" Nov 03 19:50:58.180728 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180712 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="259fae14-47ad-4823-a247-bdccc4ff5cca" volumeName="kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned" seLinuxMountContext="" Nov 03 19:50:58.180728 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180726 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5bd317fd-6ece-4ccc-81fc-50e0534a5377" volumeName="kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180740 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5bd317fd-6ece-4ccc-81fc-50e0534a5377" volumeName="kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180830 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef" volumeName="kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180867 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a847b75d-17e0-437d-8409-feb11d9a6948" volumeName="kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180885 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a847b75d-17e0-437d-8409-feb11d9a6948" volumeName="kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180914 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03bb2a46-9b02-41fd-991d-119225279dff" volumeName="kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9" seLinuxMountContext="" Nov 03 19:50:58.180942 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180932 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7860a5be-91f3-482f-8708-e075bc2f70f1" volumeName="kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180945 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7f2e664-d2c8-4a59-b220-cfa01689c0de" volumeName="kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.180999 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a161ff9-9173-4eb5-ae3d-de5622dc53e1" volumeName="kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181021 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7860a5be-91f3-482f-8708-e075bc2f70f1" volumeName="kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181078 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d2c4acc-8137-41ae-b516-4295e9ba1556" volumeName="kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181115 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37" volumeName="kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181130 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37" volumeName="kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181172 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a161ff9-9173-4eb5-ae3d-de5622dc53e1" volumeName="kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181231 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="259fae14-47ad-4823-a247-bdccc4ff5cca" volumeName="kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181264 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5bd317fd-6ece-4ccc-81fc-50e0534a5377" volumeName="kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb" seLinuxMountContext="" Nov 03 19:50:58.181284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181281 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d2c4acc-8137-41ae-b516-4295e9ba1556" volumeName="kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181322 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a46691b-91f0-4f4c-b0ef-45bcf43adc5b" volumeName="kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181356 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a46691b-91f0-4f4c-b0ef-45bcf43adc5b" volumeName="kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181398 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37" volumeName="kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181428 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a46691b-91f0-4f4c-b0ef-45bcf43adc5b" volumeName="kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181463 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a847b75d-17e0-437d-8409-feb11d9a6948" volumeName="kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181475 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c7880dce-853f-4193-a6c2-0a3f34fa5045" volumeName="kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181512 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60ba704c-b438-43e8-af83-f2cd1fa4eabf" volumeName="kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181527 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60ba704c-b438-43e8-af83-f2cd1fa4eabf" volumeName="kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181566 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef" volumeName="kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181634 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c2ea6d24-ca0a-456a-9e54-b6d34061a066" volumeName="kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181656 4456 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7f2e664-d2c8-4a59-b220-cfa01689c0de" volumeName="kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181669 4456 reconstruct.go:97] "Volume reconstruction finished" Nov 03 19:50:58.181746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.181678 4456 reconciler.go:29] "Reconciler: start to sync state" Nov 03 19:50:58.208308 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.208265 4456 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 19:50:58.209602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.209569 4456 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 19:50:58.209602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.209597 4456 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 19:50:58.209737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.209618 4456 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 19:50:58.209737 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.209657 4456 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 19:50:58.225938 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.225791 4456 generic.go:356] "Generic (PLEG): container finished" podID="e2d8647af64bbafa0ef71ce378297a23" containerID="cf3d4df051b6183d953377412c77471e7ead9e8c2378b95777c3b5595a516f3c" exitCode=0 Nov 03 19:50:58.241466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241440 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="21187b140eba3ca196cf3b185698b0e043752c74e889a19f1a5084dcf370508e" exitCode=0 Nov 03 19:50:58.241466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241463 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="7cab26619306f27dac02ee779b2b90808e7976923f41cb8ac38e52b6b21b4986" exitCode=0 Nov 03 19:50:58.241612 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241472 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="becd35e17f14a1eada5caa420144dfcca293f7944c4a4786c6bbc98b10516b6e" exitCode=0 Nov 03 19:50:58.241612 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241480 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="e906bf8a500fc2195b25cb6e6cccd2a534b168299aa66b8170c5172e7150a84f" exitCode=0 Nov 03 19:50:58.241612 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241487 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="5b1847f6ed8aae90face39f6ad98e6df0e7c0b67bea0f76ced8e395cd84f15bc" exitCode=0 Nov 03 19:50:58.241612 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.241494 4456 generic.go:356] "Generic (PLEG): container finished" podID="d7f2e664-d2c8-4a59-b220-cfa01689c0de" containerID="62232839e81ea8855ebadddd437ad5257f784973eddb51669e71b0cb33221e2e" exitCode=0 Nov 03 19:50:58.245299 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.245282 4456 manager.go:324] Recovery completed Nov 03 19:50:58.258918 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.258898 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.260058 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.260038 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.260143 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.260075 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.260143 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.260090 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.261377 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261359 4456 cpu_manager.go:226] "Starting" policy="none" Nov 03 19:50:58.261377 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261374 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.261521 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261374 4456 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 19:50:58.261521 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261471 4456 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 19:50:58.261609 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261597 4456 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 19:50:58.261639 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261612 4456 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 19:50:58.261805 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261792 4456 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 19:50:58.261840 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261809 4456 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 19:50:58.261840 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261818 4456 policy_none.go:50] "Start" Nov 03 19:50:58.261840 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261832 4456 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 19:50:58.261961 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.261847 4456 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 19:50:58.262410 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262394 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.262474 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262425 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.262474 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262436 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.262593 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262580 4456 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 19:50:58.262642 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262594 4456 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 19:50:58.262642 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.262601 4456 policy_none.go:44] "Start" Nov 03 19:50:58.266439 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.266416 4456 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 19:50:58.269520 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.269509 4456 manager.go:341] "Starting Device Plugin manager" Nov 03 19:50:58.269593 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.269532 4456 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 19:50:58.269593 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.269541 4456 server.go:87] "Starting device plugin registration server" Nov 03 19:50:58.269847 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.269833 4456 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 19:50:58.269893 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.269848 4456 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 19:50:58.269940 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.269923 4456 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 19:50:58.270063 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.270022 4456 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 19:50:58.270063 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.270066 4456 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 19:50:58.270216 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.270073 4456 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 19:50:58.270216 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.270136 4456 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T19:50:58.270057437Z","UUID":"c752c045-bb42-41ab-b4c3-79022cbb4880","Handler":null,"Name":"","Endpoint":""} Nov 03 19:50:58.271434 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.271418 4456 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 19:50:58.271530 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.271442 4456 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 19:50:58.271530 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.271456 4456 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 19:50:58.271530 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.271496 4456 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" Nov 03 19:50:58.309789 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.309716 4456 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal"] Nov 03 19:50:58.309876 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.309832 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.310731 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.310715 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.310799 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.310741 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.310799 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.310751 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.310991 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.310982 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.311158 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311143 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.311888 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311874 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.311888 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311881 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.311986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311893 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.311986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311906 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.311986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311920 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.311986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.311908 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.312102 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.312051 4456 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.312640 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312592 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerStarted","Data":"4378a9dec1978c2e35896c4f04afcf370ceee7a6e1d1648c818a52ba0edd9e8b"} Nov 03 19:50:58.312719 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312673 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerDied","Data":"cf3d4df051b6183d953377412c77471e7ead9e8c2378b95777c3b5595a516f3c"} Nov 03 19:50:58.312719 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312701 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"e2d8647af64bbafa0ef71ce378297a23","Type":"ContainerStarted","Data":"52188cf07364106269b456140249e0d1a50a439ca107f6546cf26c69cd79fc76"} Nov 03 19:50:58.312803 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312760 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"0b3dd5bb7ddeae35bdfefc31e3d9883e","Type":"ContainerStarted","Data":"ee3e94574defa78436171eeadbb785e1f7071d41367cbecbd3524887b46fb667"} Nov 03 19:50:58.312803 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312785 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" event={"ID":"0b3dd5bb7ddeae35bdfefc31e3d9883e","Type":"ContainerStarted","Data":"904ba3a4d03b0a0b9c07ff1f37509ae958baf05d2d4369cb2010b6d3a675364f"} Nov 03 19:50:58.312999 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.312985 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.314809 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.314793 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.314876 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.314821 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.314876 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.314830 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.314957 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.314943 4456 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-71.us-west-1.compute.internal\" not found" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.369986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.369962 4456 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:58.371091 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.371071 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:58.371199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.371106 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:58.371199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.371120 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:58.371199 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.371144 4456 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.382335 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.382303 4456 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:58.382435 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.382399 4456 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 19:50:58.426545 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.426524 4456 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:58.441884 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.441869 4456 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:58.442163 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.442148 4456 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:58.476697 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.476673 4456 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.482932 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.482914 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.482988 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.482941 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.482988 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.482959 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.527177 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.527150 4456 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.527307 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.527230 4456 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.527864 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.527845 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeNotReady" Nov 03 19:50:58.527920 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.527878 4456 setters.go:546] "Node became not ready" node="ip-10-0-134-71.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-03T19:50:58Z","lastTransitionTime":"2026-11-03T19:50:58Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 03 19:50:58.538090 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.538075 4456 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:58.538133 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.538112 4456 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.538133 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.538124 4456 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584031 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.583971 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584031 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.584000 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584031 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.584018 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584183 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.584062 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b3dd5bb7ddeae35bdfefc31e3d9883e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"0b3dd5bb7ddeae35bdfefc31e3d9883e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584183 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.584086 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.584183 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.584088 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e2d8647af64bbafa0ef71ce378297a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" (UID: \"e2d8647af64bbafa0ef71ce378297a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.594834 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.594786 4456 nodeinfomanager.go:471] existing CSINode "ip-10-0-134-71.us-west-1.compute.internal" is owned by different node (oldNodeID="99114ba9-e84c-4639-8db2-3eb87a43afd8", newNodeID=""), cleaning up... Nov 03 19:50:58.603227 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.603211 4456 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:58.603392 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:58.603337 4456 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:58.901292 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.901181 4456 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-71.us-west-1.compute.internal" event="NodeReady" Nov 03 19:50:58.901437 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:58.901297 4456 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 19:50:59.159308 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.159223 4456 apiserver.go:52] "Watching apiserver" Nov 03 19:50:59.247408 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.247380 4456 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:59.265579 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.265561 4456 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 19:50:59.266642 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.266614 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-85rll","openshift-multus/multus-additional-cni-plugins-56szs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-2sfnd","openshift-ovn-kubernetes/ovnkube-node-vz8bm","openshift-ingress-canary/ingress-canary-rssgq","kube-system/kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal","kube-system/global-pull-secret-syncer-tcj5c","openshift-dns/dns-default-l598k","openshift-image-registry/node-ca-m4dlp","openshift-service-ca/service-ca-5fffc97bdf-rmw54","kube-system/konnectivity-agent-98mpb","openshift-dns/node-resolver-fbwpl","openshift-multus/multus-w2c8k","openshift-network-operator/iptables-alerter-6vq2k","openshift-multus/network-metrics-daemon-2wjbn","openshift-network-diagnostics/network-check-target-mcf55","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr"] Nov 03 19:50:59.272438 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.272420 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.273402 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.273382 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.277968 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.277952 4456 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 19:50:59.288389 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288365 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.288466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288403 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5lc6\" (UniqueName: \"kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.288466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288430 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.288563 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288498 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.288563 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288525 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.288646 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288561 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.288646 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288592 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.288646 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288609 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.288646 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288622 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.288646 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288626 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-tmp-dir\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288659 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288692 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsspw\" (UniqueName: \"kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288722 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288757 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288776 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288801 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95sb9\" (UniqueName: \"kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.288844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288834 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.289107 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288869 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.289107 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288914 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:59.289107 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.288942 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.289189 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289097 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.289189 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289140 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.289189 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289171 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.289287 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289210 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289287 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289231 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.289287 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289261 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289377 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289289 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljfn\" (UniqueName: \"kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.289377 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289323 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.289429 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289419 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.289464 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289443 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkpvt\" (UniqueName: \"kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:59.289494 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289466 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289521 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289497 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:59.289552 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289522 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.289580 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289564 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.289620 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289613 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.289652 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289640 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.289680 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289663 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.289707 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289686 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289707 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289703 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289763 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289725 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.289763 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289747 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.289815 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289789 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.289815 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289810 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.289949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289856 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:59.289949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289873 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.289949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289906 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.289949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289932 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.290081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289958 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.290081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.289979 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290006 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.290081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290029 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.290081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290048 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsc2\" (UniqueName: \"kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.290205 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290092 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.290265 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290229 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2mb\" (UniqueName: \"kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.290265 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290252 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5bd317fd-6ece-4ccc-81fc-50e0534a5377-data-volume\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.290326 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290288 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290394 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290381 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290436 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290423 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290469 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290456 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290497 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290475 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qc46\" (UniqueName: \"kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290529 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290515 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.290558 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290544 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq72\" (UniqueName: \"kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.290588 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290561 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrsf\" (UniqueName: \"kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.290617 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290589 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290617 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290536 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-tmp\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290674 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290613 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.290674 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290647 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290731 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290681 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.290731 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290702 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfw4\" (UniqueName: \"kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.290783 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290729 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290783 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290752 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.290837 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290801 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290837 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290825 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.290893 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290860 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.290893 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290882 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.290947 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290893 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-tuned\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.290947 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290898 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.290947 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290931 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xljcg\" (UniqueName: \"kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.291025 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.290966 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.291025 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291008 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291079 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291043 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.291079 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291070 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.291170 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291094 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291170 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291119 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.291170 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291147 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:59.291170 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291165 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.291289 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291181 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.291289 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291195 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.291289 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291217 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291289 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291253 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291289 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291278 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291424 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291307 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.291424 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291351 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.291424 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291369 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.291424 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291405 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.291525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291432 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291449 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291491 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qsh8\" (UniqueName: \"kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.291602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291527 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7860a5be-91f3-482f-8708-e075bc2f70f1-tmp-dir\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.291602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.291530 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.309192 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.309168 4456 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:59.309312 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:50:59.309218 4456 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-71.us-west-1.compute.internal" Nov 03 19:50:59.326524 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.326502 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.326802 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.326782 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 19:50:59.326870 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.326803 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pc2lm\"" Nov 03 19:50:59.326870 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.326859 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d855x\"" Nov 03 19:50:59.326940 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.326872 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nq97\"" Nov 03 19:50:59.328994 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.328977 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 19:50:59.329165 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329152 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n4htx\"" Nov 03 19:50:59.329260 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329227 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftqzb\"" Nov 03 19:50:59.329630 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329615 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.329699 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329654 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvbsg\"" Nov 03 19:50:59.329699 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329678 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 19:50:59.329782 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329770 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.329941 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.329927 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330114 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330130 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330131 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330148 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330147 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330183 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330197 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330116 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330216 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 19:50:59.330263 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330257 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 19:50:59.330576 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330269 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.330576 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330321 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 19:50:59.330576 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330327 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2ea6d24-ca0a-456a-9e54-b6d34061a066-original-pull-secret\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.330576 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.330365 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.331852 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331692 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-config\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.331852 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331792 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-env-overrides\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.331972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331857 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60ba704c-b438-43e8-af83-f2cd1fa4eabf-iptables-alerter-script\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.331972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331878 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cni-binary-copy\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.331972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331902 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a847b75d-17e0-437d-8409-feb11d9a6948-ovnkube-script-lib\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.331972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.331904 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a847b75d-17e0-437d-8409-feb11d9a6948-ovn-node-metrics-cert\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.332135 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332037 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.332135 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332101 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.332206 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332148 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.332206 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332177 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tfxx4\"" Nov 03 19:50:59.332206 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332182 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.332366 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.332331 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9gdsm\"" Nov 03 19:50:59.339732 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.339712 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.339732 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.339728 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.340825 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.340810 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cni-binary-copy\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.360180 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.360163 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.360226 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.360218 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.373476 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.373457 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.373536 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.373504 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 03 19:50:59.377221 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377191 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.377319 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377292 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 19:50:59.377398 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377384 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.377452 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377388 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 19:50:59.377452 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377415 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.377558 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377501 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 19:50:59.377627 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377611 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 19:50:59.377732 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377677 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 19:50:59.377907 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377881 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 19:50:59.377988 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.377970 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 19:50:59.378079 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378049 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 19:50:59.378227 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378208 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 19:50:59.378430 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378376 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-926lf\"" Nov 03 19:50:59.378554 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378541 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 03 19:50:59.378600 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378579 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dqdcf\"" Nov 03 19:50:59.378647 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378619 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 19:50:59.378698 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378649 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 19:50:59.378698 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378670 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5t9k\"" Nov 03 19:50:59.378784 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378695 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-72xbf\"" Nov 03 19:50:59.378930 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378913 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 19:50:59.378930 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.378921 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzphm\"" Nov 03 19:50:59.379076 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.379059 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-x67tr\"" Nov 03 19:50:59.379785 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.379761 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dtr2r\"" Nov 03 19:50:59.380204 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380166 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2mb\" (UniqueName: \"kubernetes.io/projected/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-api-access-md2mb\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.380328 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380308 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d2c4acc-8137-41ae-b516-4295e9ba1556-konnectivity-ca\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:59.380451 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380427 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95sb9\" (UniqueName: \"kubernetes.io/projected/03bb2a46-9b02-41fd-991d-119225279dff-kube-api-access-95sb9\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.380539 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380522 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-62dzj\"" Nov 03 19:50:59.380593 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380523 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfw4\" (UniqueName: \"kubernetes.io/projected/c7880dce-853f-4193-a6c2-0a3f34fa5045-kube-api-access-jsfw4\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.380804 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380780 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5bd317fd-6ece-4ccc-81fc-50e0534a5377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.380951 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.380929 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d2c4acc-8137-41ae-b516-4295e9ba1556-agent-certs\") pod \"konnectivity-agent-98mpb\" (UID: \"7d2c4acc-8137-41ae-b516-4295e9ba1556\") " pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:50:59.381130 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381103 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qc46\" (UniqueName: \"kubernetes.io/projected/259fae14-47ad-4823-a247-bdccc4ff5cca-kube-api-access-9qc46\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.381303 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381270 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-key\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.381403 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381382 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7860a5be-91f3-482f-8708-e075bc2f70f1-config-volume\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.381476 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381345 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7860a5be-91f3-482f-8708-e075bc2f70f1-metrics-tls\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.381598 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381473 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrsf\" (UniqueName: \"kubernetes.io/projected/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-kube-api-access-vfrsf\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.381720 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381702 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-cert\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:59.381849 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381791 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qsh8\" (UniqueName: \"kubernetes.io/projected/a847b75d-17e0-437d-8409-feb11d9a6948-kube-api-access-4qsh8\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.381912 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381896 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljcg\" (UniqueName: \"kubernetes.io/projected/60ba704c-b438-43e8-af83-f2cd1fa4eabf-kube-api-access-xljcg\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.381964 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.381899 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-signing-cabundle\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.382342 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382299 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkpvt\" (UniqueName: \"kubernetes.io/projected/86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef-kube-api-access-jkpvt\") pod \"ingress-canary-rssgq\" (UID: \"86c7b9d9-b82d-4ce8-ab14-cf39ed8221ef\") " pod="openshift-ingress-canary/ingress-canary-rssgq" Nov 03 19:50:59.382492 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382472 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljfn\" (UniqueName: \"kubernetes.io/projected/7860a5be-91f3-482f-8708-e075bc2f70f1-kube-api-access-qljfn\") pod \"dns-default-l598k\" (UID: \"7860a5be-91f3-482f-8708-e075bc2f70f1\") " pod="openshift-dns/dns-default-l598k" Nov 03 19:50:59.382561 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382537 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsc2\" (UniqueName: \"kubernetes.io/projected/d7f2e664-d2c8-4a59-b220-cfa01689c0de-kube-api-access-trsc2\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.382779 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382750 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7880dce-853f-4193-a6c2-0a3f34fa5045-serviceca\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.382872 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382848 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5lc6\" (UniqueName: \"kubernetes.io/projected/aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37-kube-api-access-f5lc6\") pod \"service-ca-5fffc97bdf-rmw54\" (UID: \"aa8a6aeb-8153-4a2b-a72c-7dbb24b0ee37\") " pod="openshift-service-ca/service-ca-5fffc97bdf-rmw54" Nov 03 19:50:59.382949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.382930 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-daemon-config\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.383139 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.383106 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsspw\" (UniqueName: \"kubernetes.io/projected/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-kube-api-access-jsspw\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.383413 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.383384 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2wr\" (UniqueName: \"kubernetes.io/projected/61ec617a-e595-4e2a-a7c2-20da3189fe6d-kube-api-access-bd2wr\") pod \"network-check-target-mcf55\" (UID: \"61ec617a-e595-4e2a-a7c2-20da3189fe6d\") " pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:50:59.383515 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.383399 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq72\" (UniqueName: \"kubernetes.io/projected/16949730-542f-4d13-ac31-b546e250b748-kube-api-access-9nq72\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.392738 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392719 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392745 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392762 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392776 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392789 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392805 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.392832 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392819 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-kubelet\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392848 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-log-socket\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392848 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-cnibin\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392850 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-conf-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392871 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392882 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-kubernetes\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392894 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392873 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-etc-kubernetes\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392909 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392946 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392960 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-etc-selinux\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392964 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.392987 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393000 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393013 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393015 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-cnibin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393027 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393029 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393048 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393066 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-ovn\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393083 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-host\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393091 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393089 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-bin\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393068 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-node-log\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.393118 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393134 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393147 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-lib-modules\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393159 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393180 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393194 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393206 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-socket-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393207 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393256 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-device-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393258 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393274 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-kubelet\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393298 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-var-lib-kubelet\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393296 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393331 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393345 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393353 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393366 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-conf\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393377 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393386 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5bd317fd-6ece-4ccc-81fc-50e0534a5377-crio-socket\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393305 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-sys\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393424 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393433 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a161ff9-9173-4eb5-ae3d-de5622dc53e1-hosts-file\") pod \"node-resolver-fbwpl\" (UID: \"1a161ff9-9173-4eb5-ae3d-de5622dc53e1\") " pod="openshift-dns/node-resolver-fbwpl" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393434 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-systemd-units\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393446 4456 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393473 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393491 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysconfig\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393500 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393528 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-multus\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393569 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393603 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393623 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393643 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393662 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393675 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-sysctl-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393682 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393683 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-var-lib-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393701 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393721 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393723 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7880dce-853f-4193-a6c2-0a3f34fa5045-host\") pod \"node-ca-m4dlp\" (UID: \"c7880dce-853f-4193-a6c2-0a3f34fa5045\") " pod="openshift-image-registry/node-ca-m4dlp" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393734 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-cni-netd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393746 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393734 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-multus-certs\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393693 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-hostroot\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393768 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393777 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-etc-openvswitch\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393824 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393831 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-registration-dir\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393865 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-system-cni-dir\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393890 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-modprobe-d\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393921 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393949 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393980 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-k8s-cni-cncf-io\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.393973 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394016 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-system-cni-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394029 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394055 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394082 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16949730-542f-4d13-ac31-b546e250b748-sys-fs\") pod \"aws-ebs-csi-driver-node-2q7rr\" (UID: \"16949730-542f-4d13-ac31-b546e250b748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2q7rr" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394096 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394124 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-run-netns\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394133 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394159 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394163 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-netns\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394134 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7f2e664-d2c8-4a59-b220-cfa01689c0de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56szs\" (UID: \"d7f2e664-d2c8-4a59-b220-cfa01689c0de\") " pod="openshift-multus/multus-additional-cni-plugins-56szs" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394185 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394206 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-multus-socket-dir-parent\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394212 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60ba704c-b438-43e8-af83-f2cd1fa4eabf-host-slash\") pod \"iptables-alerter-6vq2k\" (UID: \"60ba704c-b438-43e8-af83-f2cd1fa4eabf\") " pod="openshift-network-operator/iptables-alerter-6vq2k" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394210 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394261 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-run-ovn-kubernetes\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394269 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-run-systemd\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.394220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394282 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394307 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394332 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394352 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394373 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394392 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394413 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-etc-systemd\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394428 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394465 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a46691b-91f0-4f4c-b0ef-45bcf43adc5b-host-var-lib-cni-bin\") pod \"multus-w2c8k\" (UID: \"8a46691b-91f0-4f4c-b0ef-45bcf43adc5b\") " pod="openshift-multus/multus-w2c8k" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394512 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/259fae14-47ad-4823-a247-bdccc4ff5cca-run\") pod \"tuned-2sfnd\" (UID: \"259fae14-47ad-4823-a247-bdccc4ff5cca\") " pod="openshift-cluster-node-tuning-operator/tuned-2sfnd" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394560 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-kubelet-config\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394609 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2ea6d24-ca0a-456a-9e54-b6d34061a066-dbus\") pod \"global-pull-secret-syncer-tcj5c\" (UID: \"c2ea6d24-ca0a-456a-9e54-b6d34061a066\") " pod="kube-system/global-pull-secret-syncer-tcj5c" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.394642 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a847b75d-17e0-437d-8409-feb11d9a6948-host-slash\") pod \"ovnkube-node-vz8bm\" (UID: \"a847b75d-17e0-437d-8409-feb11d9a6948\") " pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.395730 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bb2a46-9b02-41fd-991d-119225279dff-metrics-certs\") pod \"network-metrics-daemon-2wjbn\" (UID: \"03bb2a46-9b02-41fd-991d-119225279dff\") " pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.396817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.396610 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5bd317fd-6ece-4ccc-81fc-50e0534a5377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-85rll\" (UID: \"5bd317fd-6ece-4ccc-81fc-50e0534a5377\") " pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.573087 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.573060 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wjbn" Nov 03 19:50:59.574200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.574171 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-85rll" Nov 03 19:50:59.575384 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.575370 4456 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:50:59.678083 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:50:59.678056 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:51:00.008216 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:00.008190 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wjbn"] Nov 03 19:51:00.013635 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:00.011741 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bb2a46_9b02_41fd_991d_119225279dff.slice/crio-cc74960c5977a01338d2da66582af7f54815eb31d7d56590b3cf80a8465a1646 WatchSource:0}: Error finding container cc74960c5977a01338d2da66582af7f54815eb31d7d56590b3cf80a8465a1646: Status 404 returned error can't find the container with id cc74960c5977a01338d2da66582af7f54815eb31d7d56590b3cf80a8465a1646 Nov 03 19:51:00.014316 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:00.014298 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-85rll"] Nov 03 19:51:00.250715 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:00.250675 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wjbn" event={"ID":"03bb2a46-9b02-41fd-991d-119225279dff","Type":"ContainerStarted","Data":"cc74960c5977a01338d2da66582af7f54815eb31d7d56590b3cf80a8465a1646"} Nov 03 19:51:00.252159 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:00.252134 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85rll" event={"ID":"5bd317fd-6ece-4ccc-81fc-50e0534a5377","Type":"ContainerStarted","Data":"c8ca2144fb2156e81b717ebc0c797b8c4560d0998bd34e97c95403b175b8793c"} Nov 03 19:51:00.252297 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:00.252181 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85rll" event={"ID":"5bd317fd-6ece-4ccc-81fc-50e0534a5377","Type":"ContainerStarted","Data":"c7543c30cbdc02905345c93adde3d2c2e31bb08c920f08129846b0c086d10874"} Nov 03 19:51:01.354856 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:01.353078 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:51:01.354856 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:01.353332 4456 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:51:02.260106 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.260071 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wjbn" event={"ID":"03bb2a46-9b02-41fd-991d-119225279dff","Type":"ContainerStarted","Data":"5436e79bfc72b63f7eb86d715e0e4271d2aa381fe86dcc8f70bc45494d3a4d39"} Nov 03 19:51:02.260302 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.260133 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wjbn" event={"ID":"03bb2a46-9b02-41fd-991d-119225279dff","Type":"ContainerStarted","Data":"31e6f9e5907445c56baaf2529792c2d3f3f77787f55c4382724413c07878e0e1"} Nov 03 19:51:02.262028 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.262007 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l598k" event={"ID":"7860a5be-91f3-482f-8708-e075bc2f70f1","Type":"ContainerStarted","Data":"cdba043c31a364c89f35948066d5cd1487bb5bea315e605b1ebc32a12ddc7bc8"} Nov 03 19:51:02.262126 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.262048 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l598k" event={"ID":"7860a5be-91f3-482f-8708-e075bc2f70f1","Type":"ContainerStarted","Data":"f49179c46c89c8178d4df84fb726e0502618ab3754a2a6656d040b35cc60f633"} Nov 03 19:51:02.262229 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.262211 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l598k" Nov 03 19:51:02.263718 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.263698 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85rll" event={"ID":"5bd317fd-6ece-4ccc-81fc-50e0534a5377","Type":"ContainerStarted","Data":"634f657590addc1af4129852e6731285eb5888e395242f99d5bc75a1533bceb9"} Nov 03 19:51:02.511638 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:02.511566 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vz8bm" Nov 03 19:51:04.272195 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:04.272161 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-85rll" event={"ID":"5bd317fd-6ece-4ccc-81fc-50e0534a5377","Type":"ContainerStarted","Data":"9cc48e0f73d19ea4f6b9a6c53f51f2c0f4ac9f4712e462ff10920ea96665536f"} Nov 03 19:51:07.141810 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:07.141767 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:51:08.406015 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.405983 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-bzt74"] Nov 03 19:51:08.420027 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.420008 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.456159 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.456129 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlv2n\" (UniqueName: \"kubernetes.io/projected/5984c341-8a4f-472f-8872-7d40e22417b0-kube-api-access-nlv2n\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.456321 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.456175 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5984c341-8a4f-472f-8872-7d40e22417b0-tmp\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.456844 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.456824 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6"] Nov 03 19:51:08.472169 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.472140 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:08.506213 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.506187 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 03 19:51:08.506449 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.506433 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 03 19:51:08.508229 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.508199 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6"] Nov 03 19:51:08.556546 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.556489 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0673a2f4-7421-4aa7-801f-02963a157091-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xk2g6\" (UID: \"0673a2f4-7421-4aa7-801f-02963a157091\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:08.556546 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.556537 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlv2n\" (UniqueName: \"kubernetes.io/projected/5984c341-8a4f-472f-8872-7d40e22417b0-kube-api-access-nlv2n\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.556803 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.556565 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5984c341-8a4f-472f-8872-7d40e22417b0-tmp\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.556900 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.556877 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-vzl8h\"" Nov 03 19:51:08.556958 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.556940 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5984c341-8a4f-472f-8872-7d40e22417b0-tmp\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.557342 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.557325 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-bzt74"] Nov 03 19:51:08.557759 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.557742 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86f489569c-cvdjq"] Nov 03 19:51:08.582165 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.582142 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.592644 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.592623 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f489569c-cvdjq"] Nov 03 19:51:08.613270 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.613227 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zxzvp\"" Nov 03 19:51:08.613270 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.613230 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 03 19:51:08.627606 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.627587 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlv2n\" (UniqueName: \"kubernetes.io/projected/5984c341-8a4f-472f-8872-7d40e22417b0-kube-api-access-nlv2n\") pod \"downloads-6dd789c8b7-bzt74\" (UID: \"5984c341-8a4f-472f-8872-7d40e22417b0\") " pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.657543 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657488 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-tls\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657543 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657515 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-image-registry-private-configuration\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657543 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657532 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-installation-pull-secrets\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657714 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657548 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6r9h\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-kube-api-access-g6r9h\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657714 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657620 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-certificates\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657776 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657743 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-trusted-ca\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657776 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657765 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-bound-sa-token\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.657848 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657790 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0673a2f4-7421-4aa7-801f-02963a157091-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xk2g6\" (UID: \"0673a2f4-7421-4aa7-801f-02963a157091\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:08.657848 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.657807 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-ca-trust-extracted\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.660211 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.660192 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0673a2f4-7421-4aa7-801f-02963a157091-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-xk2g6\" (UID: \"0673a2f4-7421-4aa7-801f-02963a157091\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:08.687877 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.687857 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 03 19:51:08.713381 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.713364 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 03 19:51:08.713525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.713410 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fsnsn\"" Nov 03 19:51:08.713525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.713498 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 03 19:51:08.713606 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.713546 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 03 19:51:08.742253 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.742213 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:08.758797 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758778 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-trusted-ca\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758869 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758812 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-bound-sa-token\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758869 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758842 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-ca-trust-extracted\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758895 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-tls\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758932 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-image-registry-private-configuration\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758958 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-installation-pull-secrets\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.758987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.758982 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6r9h\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-kube-api-access-g6r9h\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.759171 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.759025 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-certificates\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.759299 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.759277 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-ca-trust-extracted\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.760141 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.760117 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-trusted-ca\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.761182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.761155 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-certificates\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.761702 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.761677 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-registry-tls\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.762025 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.762005 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-installation-pull-secrets\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.762169 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.762152 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-image-registry-private-configuration\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.796706 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.796668 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:08.835903 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.835881 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-bound-sa-token\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.836069 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.836052 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6r9h\" (UniqueName: \"kubernetes.io/projected/da9fdec9-3a41-4e5a-a025-c8fd30fa4091-kube-api-access-g6r9h\") pod \"image-registry-86f489569c-cvdjq\" (UID: \"da9fdec9-3a41-4e5a-a025-c8fd30fa4091\") " pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:08.907449 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:08.907422 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:09.173598 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.173526 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-bzt74"] Nov 03 19:51:09.176489 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:09.176461 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5984c341_8a4f_472f_8872_7d40e22417b0.slice/crio-0cb80d6290db407a397b3688c38854a4a12b2e8eb0464e2db6c8546788008efb WatchSource:0}: Error finding container 0cb80d6290db407a397b3688c38854a4a12b2e8eb0464e2db6c8546788008efb: Status 404 returned error can't find the container with id 0cb80d6290db407a397b3688c38854a4a12b2e8eb0464e2db6c8546788008efb Nov 03 19:51:09.224863 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.224766 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6"] Nov 03 19:51:09.227568 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:09.227537 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0673a2f4_7421_4aa7_801f_02963a157091.slice/crio-41635667fd65570df01c8010943f56dca289e5ec29261e616bf145eb2f632098 WatchSource:0}: Error finding container 41635667fd65570df01c8010943f56dca289e5ec29261e616bf145eb2f632098: Status 404 returned error can't find the container with id 41635667fd65570df01c8010943f56dca289e5ec29261e616bf145eb2f632098 Nov 03 19:51:09.288817 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.288785 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-bzt74" event={"ID":"5984c341-8a4f-472f-8872-7d40e22417b0","Type":"ContainerStarted","Data":"0cb80d6290db407a397b3688c38854a4a12b2e8eb0464e2db6c8546788008efb"} Nov 03 19:51:09.289998 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.289963 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" event={"ID":"0673a2f4-7421-4aa7-801f-02963a157091","Type":"ContainerStarted","Data":"41635667fd65570df01c8010943f56dca289e5ec29261e616bf145eb2f632098"} Nov 03 19:51:09.295663 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.295641 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f489569c-cvdjq"] Nov 03 19:51:09.298479 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:09.298458 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9fdec9_3a41_4e5a_a025_c8fd30fa4091.slice/crio-b4ed1801f9f0c37ed67ac0dfff8f5b0a9f3bd05ef10e90f258da6b0177b474a2 WatchSource:0}: Error finding container b4ed1801f9f0c37ed67ac0dfff8f5b0a9f3bd05ef10e90f258da6b0177b474a2: Status 404 returned error can't find the container with id b4ed1801f9f0c37ed67ac0dfff8f5b0a9f3bd05ef10e90f258da6b0177b474a2 Nov 03 19:51:09.627876 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:09.627851 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-98mpb" Nov 03 19:51:10.297664 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:10.297630 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" event={"ID":"da9fdec9-3a41-4e5a-a025-c8fd30fa4091","Type":"ContainerStarted","Data":"690567096a60dc11003169aa93e2e0bf8e1aa80abe5de851e72851c7652c8ea4"} Nov 03 19:51:10.297822 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:10.297702 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" event={"ID":"da9fdec9-3a41-4e5a-a025-c8fd30fa4091","Type":"ContainerStarted","Data":"b4ed1801f9f0c37ed67ac0dfff8f5b0a9f3bd05ef10e90f258da6b0177b474a2"} Nov 03 19:51:10.297822 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:10.297738 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:10.763620 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:51:10.763546 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:51:12.268837 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.268800 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l598k" Nov 03 19:51:12.309069 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.309033 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" event={"ID":"0673a2f4-7421-4aa7-801f-02963a157091","Type":"ContainerStarted","Data":"194db5ce2cd87cd70575e6fec350db3608fe39e95c702d497e1f9a90b9b6493f"} Nov 03 19:51:12.309308 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.309284 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:12.314614 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.314591 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" Nov 03 19:51:12.389178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.389115 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" podStartSLOduration=4.389096384 podStartE2EDuration="4.389096384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:10.424921842 +0000 UTC m=+12.325023647" watchObservedRunningTime="2026-11-03 19:51:12.389096384 +0000 UTC m=+14.289198192" Nov 03 19:51:12.506256 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:12.506193 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-xk2g6" podStartSLOduration=2.410784112 podStartE2EDuration="4.506178538s" totalImagesPullingTime="2.095394426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:12.505698325 +0000 UTC m=+14.405800137" watchObservedRunningTime="2026-11-03 19:51:12.506178538 +0000 UTC m=+14.406280354" Nov 03 19:51:19.653693 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.653657 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bhz9z"] Nov 03 19:51:19.656075 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.656051 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.709517 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.709461 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 19:51:19.709759 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.709710 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 19:51:19.737429 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737402 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-textfile\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737560 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737435 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhgt\" (UniqueName: \"kubernetes.io/projected/a211ad0c-1cad-4320-8d49-1b545abfea57-kube-api-access-pbhgt\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737560 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737457 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737560 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737485 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-tls\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737560 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737535 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737755 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737657 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-wtmp\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737755 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737708 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-sys\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737755 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737741 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-root\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.737869 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.737766 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-metrics-client-ca\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.761350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.760616 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qfjjk\"" Nov 03 19:51:19.761350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.760665 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 19:51:19.761350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.760828 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 19:51:19.761350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.761011 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 19:51:19.761350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.761084 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 19:51:19.838680 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838644 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-sys\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838680 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838685 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-root\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838702 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-metrics-client-ca\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838736 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-textfile\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838758 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhgt\" (UniqueName: \"kubernetes.io/projected/a211ad0c-1cad-4320-8d49-1b545abfea57-kube-api-access-pbhgt\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838766 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-sys\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838788 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838841 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-tls\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838873 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.838931 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838916 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-wtmp\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.839336 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.839067 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-wtmp\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.839336 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.838772 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a211ad0c-1cad-4320-8d49-1b545abfea57-root\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.839336 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.839125 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-textfile\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.839500 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.839385 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-metrics-client-ca\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.839618 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.839594 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.841560 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.841536 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.841688 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.841638 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a211ad0c-1cad-4320-8d49-1b545abfea57-node-exporter-tls\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.901757 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.901731 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhgt\" (UniqueName: \"kubernetes.io/projected/a211ad0c-1cad-4320-8d49-1b545abfea57-kube-api-access-pbhgt\") pod \"node-exporter-bhz9z\" (UID: \"a211ad0c-1cad-4320-8d49-1b545abfea57\") " pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.970374 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:19.970295 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhz9z" Nov 03 19:51:19.987386 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:19.987351 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda211ad0c_1cad_4320_8d49_1b545abfea57.slice/crio-7855b52ce063da0239e3c347cfb4006050709b1e74e92f76975e4ed26fcd9dce WatchSource:0}: Error finding container 7855b52ce063da0239e3c347cfb4006050709b1e74e92f76975e4ed26fcd9dce: Status 404 returned error can't find the container with id 7855b52ce063da0239e3c347cfb4006050709b1e74e92f76975e4ed26fcd9dce Nov 03 19:51:20.337837 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:20.337792 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhz9z" event={"ID":"a211ad0c-1cad-4320-8d49-1b545abfea57","Type":"ContainerStarted","Data":"7855b52ce063da0239e3c347cfb4006050709b1e74e92f76975e4ed26fcd9dce"} Nov 03 19:51:22.348250 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:22.348207 4456 generic.go:356] "Generic (PLEG): container finished" podID="a211ad0c-1cad-4320-8d49-1b545abfea57" containerID="5167368c68ad4d43380a19b26982b5c77a1d07f41d44358fc2897935fee88bfb" exitCode=0 Nov 03 19:51:22.348735 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:22.348276 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhz9z" event={"ID":"a211ad0c-1cad-4320-8d49-1b545abfea57","Type":"ContainerDied","Data":"5167368c68ad4d43380a19b26982b5c77a1d07f41d44358fc2897935fee88bfb"} Nov 03 19:51:23.358031 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:23.357989 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhz9z" event={"ID":"a211ad0c-1cad-4320-8d49-1b545abfea57","Type":"ContainerStarted","Data":"e4b45a70dfd09c230fd1a35ff7503f24933fde773509f11169642f1498589e8a"} Nov 03 19:51:23.358518 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:23.358068 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhz9z" event={"ID":"a211ad0c-1cad-4320-8d49-1b545abfea57","Type":"ContainerStarted","Data":"01b5eb8132ce4c1e9bebf7e3a0ecccbad566c78250446d6aac9ed0d32290d31b"} Nov 03 19:51:23.481365 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:23.481302 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bhz9z" podStartSLOduration=3.005479374 podStartE2EDuration="4.48128467s" totalImagesPullingTime="1.38815383s" totalInitContainerRuntime="87.651466ms" isStatefulPod=true podCreationTimestamp="2026-11-03 19:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:23.479359486 +0000 UTC m=+25.379461289" watchObservedRunningTime="2026-11-03 19:51:23.48128467 +0000 UTC m=+25.381386520" Nov 03 19:51:24.304655 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.304615 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p"] Nov 03 19:51:24.306750 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.306716 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.368626 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.368585 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p"] Nov 03 19:51:24.378166 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.378140 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbd1a511-106c-4178-8103-af1c50a783f5-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.378298 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.378194 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqvvw\" (UniqueName: \"kubernetes.io/projected/bbd1a511-106c-4178-8103-af1c50a783f5-kube-api-access-mqvvw\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.399053 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.399020 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-grvfz\"" Nov 03 19:51:24.399053 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.399023 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Nov 03 19:51:24.479212 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.479170 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbd1a511-106c-4178-8103-af1c50a783f5-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.479212 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.479227 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqvvw\" (UniqueName: \"kubernetes.io/projected/bbd1a511-106c-4178-8103-af1c50a783f5-kube-api-access-mqvvw\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.482499 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.482475 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bbd1a511-106c-4178-8103-af1c50a783f5-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.542578 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.542544 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqvvw\" (UniqueName: \"kubernetes.io/projected/bbd1a511-106c-4178-8103-af1c50a783f5-kube-api-access-mqvvw\") pod \"monitoring-plugin-77f4f76594-vdm9p\" (UID: \"bbd1a511-106c-4178-8103-af1c50a783f5\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.618383 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.618307 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:24.995271 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:24.995219 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p"] Nov 03 19:51:24.998841 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:51:24.998810 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd1a511_106c_4178_8103_af1c50a783f5.slice/crio-60ea845e8d6d7faec3eec7d19529bf5df01a0edbb6a4b580982cf40e24a9ea22 WatchSource:0}: Error finding container 60ea845e8d6d7faec3eec7d19529bf5df01a0edbb6a4b580982cf40e24a9ea22: Status 404 returned error can't find the container with id 60ea845e8d6d7faec3eec7d19529bf5df01a0edbb6a4b580982cf40e24a9ea22 Nov 03 19:51:25.367315 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:25.367208 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" event={"ID":"bbd1a511-106c-4178-8103-af1c50a783f5","Type":"ContainerStarted","Data":"60ea845e8d6d7faec3eec7d19529bf5df01a0edbb6a4b580982cf40e24a9ea22"} Nov 03 19:51:26.376284 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:26.374320 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-bzt74" event={"ID":"5984c341-8a4f-472f-8872-7d40e22417b0","Type":"ContainerStarted","Data":"6f05b4b022ddc50be365a8ec698db82cf6ea119c2c0346cffd56de8ae4f50ce3"} Nov 03 19:51:26.377692 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:26.377663 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:26.395090 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:26.395063 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-bzt74" Nov 03 19:51:26.596938 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:26.596876 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-bzt74" podStartSLOduration=1.933280638 podStartE2EDuration="18.596854576s" totalImagesPullingTime="16.663573938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:26.544519122 +0000 UTC m=+28.444620928" watchObservedRunningTime="2026-11-03 19:51:26.596854576 +0000 UTC m=+28.496956364" Nov 03 19:51:27.145567 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:27.145537 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mcf55" Nov 03 19:51:27.384796 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:27.384713 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" event={"ID":"bbd1a511-106c-4178-8103-af1c50a783f5","Type":"ContainerStarted","Data":"b65fd9b275fc87bd8651bff927715c1e0cbc7831349aa4d69c686ad72034b5ee"} Nov 03 19:51:27.510300 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:27.510211 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" podStartSLOduration=1.508685828 podStartE2EDuration="3.510194338s" totalImagesPullingTime="2.00150851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:27.509468002 +0000 UTC m=+29.409569809" watchObservedRunningTime="2026-11-03 19:51:27.510194338 +0000 UTC m=+29.410296181" Nov 03 19:51:28.388063 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:28.388033 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:28.393449 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:28.393415 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vdm9p" Nov 03 19:51:31.309820 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:31.309788 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86f489569c-cvdjq" Nov 03 19:51:40.753904 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:51:40.753816 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:51:59.214370 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.214330 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56d94fd96b-4kp74"] Nov 03 19:51:59.258358 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.258320 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.265726 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.265700 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56d94fd96b-4kp74"] Nov 03 19:51:59.313005 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.312979 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 03 19:51:59.313166 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.313014 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 03 19:51:59.313166 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.313102 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 03 19:51:59.313329 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.313202 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 03 19:51:59.313329 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.313283 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fmrgt\"" Nov 03 19:51:59.313968 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.313951 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 03 19:51:59.418748 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.418682 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 03 19:51:59.436260 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436220 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436393 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436274 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436393 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436301 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436468 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436392 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-federate-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436468 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436420 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436468 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436447 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-serving-certs-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436555 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436496 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v4x6\" (UniqueName: \"kubernetes.io/projected/fc601e41-54fc-4e11-b325-42ccb2cfd389-kube-api-access-5v4x6\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.436589 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.436553 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-metrics-client-ca\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.536987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.536957 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-serving-certs-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.536987 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.536993 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v4x6\" (UniqueName: \"kubernetes.io/projected/fc601e41-54fc-4e11-b325-42ccb2cfd389-kube-api-access-5v4x6\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537013 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-metrics-client-ca\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537038 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537064 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537085 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537110 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-federate-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537126 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537845 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537812 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-serving-certs-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.537960 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.537842 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-metrics-client-ca\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.538027 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.538006 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.539922 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.539899 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-telemeter-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.540021 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.539957 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.540200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.540184 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.540318 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.540299 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc601e41-54fc-4e11-b325-42ccb2cfd389-federate-client-tls\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.603269 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.603223 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v4x6\" (UniqueName: \"kubernetes.io/projected/fc601e41-54fc-4e11-b325-42ccb2cfd389-kube-api-access-5v4x6\") pod \"telemeter-client-56d94fd96b-4kp74\" (UID: \"fc601e41-54fc-4e11-b325-42ccb2cfd389\") " pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:51:59.619014 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:51:59.618990 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" Nov 03 19:52:00.121886 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:00.121859 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56d94fd96b-4kp74"] Nov 03 19:52:00.123614 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:52:00.123591 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc601e41_54fc_4e11_b325_42ccb2cfd389.slice/crio-95ea70d2817baaa21041e708772dc366fa99d81d469d6efd4ce53a387aa0f921 WatchSource:0}: Error finding container 95ea70d2817baaa21041e708772dc366fa99d81d469d6efd4ce53a387aa0f921: Status 404 returned error can't find the container with id 95ea70d2817baaa21041e708772dc366fa99d81d469d6efd4ce53a387aa0f921 Nov 03 19:52:00.486299 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:00.486263 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" event={"ID":"fc601e41-54fc-4e11-b325-42ccb2cfd389","Type":"ContainerStarted","Data":"95ea70d2817baaa21041e708772dc366fa99d81d469d6efd4ce53a387aa0f921"} Nov 03 19:52:03.496753 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:03.496719 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" event={"ID":"fc601e41-54fc-4e11-b325-42ccb2cfd389","Type":"ContainerStarted","Data":"484c70628f2e8e09de33db2ee690b5ab28b7d03bb1786a8b7e071096cbdd6633"} Nov 03 19:52:05.507996 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:05.507956 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" event={"ID":"fc601e41-54fc-4e11-b325-42ccb2cfd389","Type":"ContainerStarted","Data":"182af6df5597b284b12ecb49a43b2931f3b8684558350a0f4f740d940bec7d3c"} Nov 03 19:52:05.508429 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:05.508041 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" event={"ID":"fc601e41-54fc-4e11-b325-42ccb2cfd389","Type":"ContainerStarted","Data":"9612cfed4d22b5936a45abf6d971a4b87e59f28e7cf4e3046f008b18eb9b33d5"} Nov 03 19:52:05.735105 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:52:05.735054 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56d94fd96b-4kp74" podStartSLOduration=2.302160594 podStartE2EDuration="6.735035224s" totalImagesPullingTime="4.43287463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:51:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:52:05.733994195 +0000 UTC m=+67.634096000" watchObservedRunningTime="2026-11-03 19:52:05.735035224 +0000 UTC m=+67.635137032" Nov 03 19:52:10.753476 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:52:10.753440 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:52:40.753740 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:52:40.753703 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:53:10.752534 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:53:10.752458 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:53:40.753555 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:53:40.753515 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:54:10.752526 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:54:10.752488 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:54:40.753141 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:54:40.753059 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:55:10.754223 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:55:10.754180 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:55:12.643671 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.643630 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4"] Nov 03 19:55:12.648084 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.648059 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.753219 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.753192 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 19:55:12.753461 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.753443 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 19:55:12.753558 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.753541 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-8fchc\"" Nov 03 19:55:12.754656 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.754637 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4"] Nov 03 19:55:12.760099 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.760084 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.760158 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.760108 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.760158 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.760146 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmpf2\" (UniqueName: \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.861037 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.861005 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmpf2\" (UniqueName: \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.861200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.861056 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.861200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.861175 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.861515 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.861494 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.861553 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.861508 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.924401 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.924331 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmpf2\" (UniqueName: \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:12.963077 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:12.963048 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:13.061042 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.061009 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:55:13.064178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.064160 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.117994 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.117963 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 19:55:13.118142 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.118003 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 03 19:55:13.118182 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.118158 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 03 19:55:13.121195 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.121182 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 03 19:55:13.127485 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.127455 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:55:13.164212 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164177 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164212 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164216 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7z72\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164444 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164263 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164444 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164397 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164444 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164434 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164556 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164458 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.164556 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.164522 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.219825 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.219741 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 19:55:13.219825 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.219779 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 19:55:13.219993 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.219856 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cdr4k\"" Nov 03 19:55:13.265171 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265143 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265189 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265216 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265263 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265300 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7z72\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265527 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265330 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.265616 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.265536 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.266064 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.266013 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.267711 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.267681 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.267815 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.267757 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.267815 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.267803 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.268183 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.268166 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.328788 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.328757 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.335161 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.335136 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7z72\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\") pod \"istiod-openshift-gateway-7876bfcb74-gnvm4\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.349452 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.349433 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4"] Nov 03 19:55:13.351718 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:55:13.351695 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca98d69b_5004_436a_8b42_2a44881f3ebc.slice/crio-54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7 WatchSource:0}: Error finding container 54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7: Status 404 returned error can't find the container with id 54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7 Nov 03 19:55:13.375739 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.375715 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:13.796864 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:13.796830 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:55:13.799628 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:55:13.799599 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3fbb2d_1d8d_456e_ae33_5f86d498eaf2.slice/crio-187fdfe92efd47c6b269eb3903ff10ce5bdea03e0d8cb212a69c007ba7036fe4 WatchSource:0}: Error finding container 187fdfe92efd47c6b269eb3903ff10ce5bdea03e0d8cb212a69c007ba7036fe4: Status 404 returned error can't find the container with id 187fdfe92efd47c6b269eb3903ff10ce5bdea03e0d8cb212a69c007ba7036fe4 Nov 03 19:55:14.087903 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:14.087812 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" event={"ID":"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2","Type":"ContainerStarted","Data":"187fdfe92efd47c6b269eb3903ff10ce5bdea03e0d8cb212a69c007ba7036fe4"} Nov 03 19:55:14.088943 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:14.088911 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" event={"ID":"ca98d69b-5004-436a-8b42-2a44881f3ebc","Type":"ContainerStarted","Data":"54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7"} Nov 03 19:55:18.810750 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:18.810440 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 19:55:18.810750 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:18.810504 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 19:55:19.109772 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:19.109680 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" event={"ID":"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2","Type":"ContainerStarted","Data":"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462"} Nov 03 19:55:19.109944 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:19.109928 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:19.111876 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:19.111847 4456 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-gnvm4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 19:55:19.111972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:19.111921 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 19:55:19.322662 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:19.322607 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" podStartSLOduration=1.314674695 podStartE2EDuration="6.32259088s" totalImagesPullingTime="5.007916185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:19.283322933 +0000 UTC m=+261.183424742" watchObservedRunningTime="2026-11-03 19:55:19.32259088 +0000 UTC m=+261.222692685" Nov 03 19:55:20.115348 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:20.115306 4456 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-gnvm4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 19:55:20.115801 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:20.115381 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 19:55:21.120088 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:21.120051 4456 generic.go:356] "Generic (PLEG): container finished" podID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerID="c42a0d7311cf40da41a133c8fbeb5b9bdc573d61404a9a8f666014aecc7dd375" exitCode=0 Nov 03 19:55:21.120509 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:21.120114 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" event={"ID":"ca98d69b-5004-436a-8b42-2a44881f3ebc","Type":"ContainerDied","Data":"c42a0d7311cf40da41a133c8fbeb5b9bdc573d61404a9a8f666014aecc7dd375"} Nov 03 19:55:23.116085 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:23.116052 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:55:25.135175 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:25.135143 4456 generic.go:356] "Generic (PLEG): container finished" podID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerID="eaced515ad9005d255dbe2e852dca8b4022a0e37a558b872d4787a212f37b013" exitCode=0 Nov 03 19:55:25.135581 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:25.135254 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" event={"ID":"ca98d69b-5004-436a-8b42-2a44881f3ebc","Type":"ContainerDied","Data":"eaced515ad9005d255dbe2e852dca8b4022a0e37a558b872d4787a212f37b013"} Nov 03 19:55:34.169651 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:34.169573 4456 generic.go:356] "Generic (PLEG): container finished" podID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerID="b0226cacc41acd78e32b6feaa65ae3240af6d31f0672ee1da30d89d963b88c2c" exitCode=0 Nov 03 19:55:34.169651 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:34.169629 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" event={"ID":"ca98d69b-5004-436a-8b42-2a44881f3ebc","Type":"ContainerDied","Data":"b0226cacc41acd78e32b6feaa65ae3240af6d31f0672ee1da30d89d963b88c2c"} Nov 03 19:55:35.336558 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.336527 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:35.456609 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.456343 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\") pod \"ca98d69b-5004-436a-8b42-2a44881f3ebc\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " Nov 03 19:55:35.456609 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.456393 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\" (UniqueName: \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\") pod \"ca98d69b-5004-436a-8b42-2a44881f3ebc\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " Nov 03 19:55:35.456609 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.456479 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\") pod \"ca98d69b-5004-436a-8b42-2a44881f3ebc\" (UID: \"ca98d69b-5004-436a-8b42-2a44881f3ebc\") " Nov 03 19:55:35.457356 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.457299 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle" pod "ca98d69b-5004-436a-8b42-2a44881f3ebc" (UID: "ca98d69b-5004-436a-8b42-2a44881f3ebc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:35.459545 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.459518 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2" pod "ca98d69b-5004-436a-8b42-2a44881f3ebc" (UID: "ca98d69b-5004-436a-8b42-2a44881f3ebc"). InnerVolumeSpecName "kube-api-access-vmpf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:35.462855 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.462825 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util" pod "ca98d69b-5004-436a-8b42-2a44881f3ebc" (UID: "ca98d69b-5004-436a-8b42-2a44881f3ebc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:35.558005 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.557967 4456 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-bundle\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:35.558005 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.557998 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmpf2\" (UniqueName: \"kubernetes.io/projected/ca98d69b-5004-436a-8b42-2a44881f3ebc-kube-api-access-vmpf2\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:35.558005 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:35.558008 4456 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ca98d69b-5004-436a-8b42-2a44881f3ebc-util\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:36.177604 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:36.177576 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" Nov 03 19:55:36.177751 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:36.177572 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ccwpm4" event={"ID":"ca98d69b-5004-436a-8b42-2a44881f3ebc","Type":"ContainerDied","Data":"54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7"} Nov 03 19:55:36.177751 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:55:36.177700 4456 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54a2f0936947a0e231214ec5eea12ac972ee618126865aa1cdb85223b2bc91d7" Nov 03 19:55:40.753944 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:55:40.753894 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:56:10.753717 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:56:10.753626 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:56:11.570901 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.570865 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx"] Nov 03 19:56:11.571121 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571109 4456 cpu_manager.go:414] "containerMap: removing container" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="pull" Nov 03 19:56:11.571162 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571122 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="pull" Nov 03 19:56:11.571162 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571141 4456 cpu_manager.go:414] "containerMap: removing container" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="util" Nov 03 19:56:11.571162 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571146 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="util" Nov 03 19:56:11.571162 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571154 4456 cpu_manager.go:414] "containerMap: removing container" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="extract" Nov 03 19:56:11.571162 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571158 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="extract" Nov 03 19:56:11.571334 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.571200 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca98d69b-5004-436a-8b42-2a44881f3ebc" containerName="extract" Nov 03 19:56:11.572927 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.572912 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614258 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614206 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614423 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614270 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614462 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614422 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52w42\" (UniqueName: \"kubernetes.io/projected/4f31fbed-9235-4be1-bd7b-5cc12858287f-kube-api-access-52w42\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614495 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614470 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614585 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614564 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.614619 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.614594 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.685820 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.685785 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 03 19:56:11.685820 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.685795 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 03 19:56:11.686064 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.685976 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 03 19:56:11.686064 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.686024 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-tffct\"" Nov 03 19:56:11.705461 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.705429 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx"] Nov 03 19:56:11.709175 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.709148 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 03 19:56:11.709315 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.709179 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 03 19:56:11.715513 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715494 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715564 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715548 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52w42\" (UniqueName: \"kubernetes.io/projected/4f31fbed-9235-4be1-bd7b-5cc12858287f-kube-api-access-52w42\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715665 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715590 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715665 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715618 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715665 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715637 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715808 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715691 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.715986 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.715969 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.718447 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.718423 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.718745 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.718699 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f31fbed-9235-4be1-bd7b-5cc12858287f-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.718745 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.718727 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.718960 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.718939 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f31fbed-9235-4be1-bd7b-5cc12858287f-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.778205 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.778171 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52w42\" (UniqueName: \"kubernetes.io/projected/4f31fbed-9235-4be1-bd7b-5cc12858287f-kube-api-access-52w42\") pod \"opendatahub-operator-controller-manager-756fd67b76-xg7mx\" (UID: \"4f31fbed-9235-4be1-bd7b-5cc12858287f\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:11.884410 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:11.884325 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:12.381696 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:12.381592 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx"] Nov 03 19:56:12.384434 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:56:12.384396 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f31fbed_9235_4be1_bd7b_5cc12858287f.slice/crio-82b6310a2d108ebe5214cac67ac1878bffe6d983d44092b6d987577a6d9be3eb WatchSource:0}: Error finding container 82b6310a2d108ebe5214cac67ac1878bffe6d983d44092b6d987577a6d9be3eb: Status 404 returned error can't find the container with id 82b6310a2d108ebe5214cac67ac1878bffe6d983d44092b6d987577a6d9be3eb Nov 03 19:56:12.385963 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:12.385942 4456 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:56:13.301795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:13.301763 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" event={"ID":"4f31fbed-9235-4be1-bd7b-5cc12858287f","Type":"ContainerStarted","Data":"82b6310a2d108ebe5214cac67ac1878bffe6d983d44092b6d987577a6d9be3eb"} Nov 03 19:56:16.314927 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:16.314897 4456 generic.go:356] "Generic (PLEG): container finished" podID="4f31fbed-9235-4be1-bd7b-5cc12858287f" containerID="8f42d792dd089eb1e7b3857e288aef3a71738555679fdb5a6b13907a13364ee1" exitCode=0 Nov 03 19:56:16.315292 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:16.314958 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" event={"ID":"4f31fbed-9235-4be1-bd7b-5cc12858287f","Type":"ContainerDied","Data":"8f42d792dd089eb1e7b3857e288aef3a71738555679fdb5a6b13907a13364ee1"} Nov 03 19:56:17.320601 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:17.320569 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" event={"ID":"4f31fbed-9235-4be1-bd7b-5cc12858287f","Type":"ContainerStarted","Data":"4ba492d123d2cb7c340337f6ba847a1d232328e4363b765eda5702808c558099"} Nov 03 19:56:17.320981 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:17.320709 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:17.570781 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:17.570732 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" podStartSLOduration=1.91499992 podStartE2EDuration="6.570717778s" totalImagesPullingTime="4.242264223s" totalInitContainerRuntime="413.453635ms" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:17.519482658 +0000 UTC m=+319.419584458" watchObservedRunningTime="2026-11-03 19:56:17.570717778 +0000 UTC m=+319.470819584" Nov 03 19:56:28.325619 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:28.325585 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-xg7mx" Nov 03 19:56:40.752871 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:56:40.752830 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:56:46.983599 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:46.983564 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj"] Nov 03 19:56:46.985716 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:46.985699 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.092348 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.092313 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj"] Nov 03 19:56:47.095137 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.095103 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6h47\" (UniqueName: \"kubernetes.io/projected/2bb67ba3-76b8-49a4-a4d1-199d1489585d-kube-api-access-g6h47\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.095298 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.095182 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tmp\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.095298 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.095217 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tls-certs\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.141827 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.141798 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s52bn\"" Nov 03 19:56:47.154347 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.154323 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Nov 03 19:56:47.154463 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.154350 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Nov 03 19:56:47.196592 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.196563 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6h47\" (UniqueName: \"kubernetes.io/projected/2bb67ba3-76b8-49a4-a4d1-199d1489585d-kube-api-access-g6h47\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.196592 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.196594 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tmp\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.196771 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.196618 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tls-certs\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.198990 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.198970 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tmp\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.199127 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.199109 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bb67ba3-76b8-49a4-a4d1-199d1489585d-tls-certs\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.258671 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.258638 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6h47\" (UniqueName: \"kubernetes.io/projected/2bb67ba3-76b8-49a4-a4d1-199d1489585d-kube-api-access-g6h47\") pod \"kube-auth-proxy-655c576ffb-dbtgj\" (UID: \"2bb67ba3-76b8-49a4-a4d1-199d1489585d\") " pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.296702 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.296673 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" Nov 03 19:56:47.674264 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:47.674222 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj"] Nov 03 19:56:47.676579 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:56:47.676538 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb67ba3_76b8_49a4_a4d1_199d1489585d.slice/crio-1c8e4a35944b37cddeb7f6d70d10eb802d96b1d4fe997789970d3adc964e128e WatchSource:0}: Error finding container 1c8e4a35944b37cddeb7f6d70d10eb802d96b1d4fe997789970d3adc964e128e: Status 404 returned error can't find the container with id 1c8e4a35944b37cddeb7f6d70d10eb802d96b1d4fe997789970d3adc964e128e Nov 03 19:56:48.428900 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:48.428865 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" event={"ID":"2bb67ba3-76b8-49a4-a4d1-199d1489585d","Type":"ContainerStarted","Data":"1c8e4a35944b37cddeb7f6d70d10eb802d96b1d4fe997789970d3adc964e128e"} Nov 03 19:56:51.441991 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:51.441955 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" event={"ID":"2bb67ba3-76b8-49a4-a4d1-199d1489585d","Type":"ContainerStarted","Data":"e2d711cfa0173dbbfa47555683da435a9bf714a5de3646ded5600679a049a714"} Nov 03 19:56:51.559915 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:51.559861 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-655c576ffb-dbtgj" podStartSLOduration=2.68978254 podStartE2EDuration="5.55984861s" totalImagesPullingTime="2.87006607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:51.559649392 +0000 UTC m=+353.459751201" watchObservedRunningTime="2026-11-03 19:56:51.55984861 +0000 UTC m=+353.459950416" Nov 03 19:56:53.611367 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.611334 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:56:53.616864 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.615895 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 19:56:53.617374 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.617355 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:56:53.619878 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.619856 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.671435 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.671401 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:56:53.721514 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.721491 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 03 19:56:53.721677 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.721545 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vps74\"" Nov 03 19:56:53.721677 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.721548 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 03 19:56:53.721790 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.721747 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 03 19:56:53.721790 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.721762 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z4ztg\"" Nov 03 19:56:53.723004 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.722977 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 19:56:53.751309 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.751278 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c26d246-c89e-413d-942d-a97267065c8f-config-file\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.751433 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.751313 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4vs\" (UniqueName: \"kubernetes.io/projected/6c26d246-c89e-413d-942d-a97267065c8f-kube-api-access-cm4vs\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.751433 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.751336 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9vv\" (UniqueName: \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\") pod \"authorino-56c6c9ddd5-snmh8\" (UID: \"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1\") " pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:56:53.852610 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.852579 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c26d246-c89e-413d-942d-a97267065c8f-config-file\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.852753 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.852627 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4vs\" (UniqueName: \"kubernetes.io/projected/6c26d246-c89e-413d-942d-a97267065c8f-kube-api-access-cm4vs\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.852753 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.852742 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9vv\" (UniqueName: \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\") pod \"authorino-56c6c9ddd5-snmh8\" (UID: \"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1\") " pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:56:53.853168 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.853148 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6c26d246-c89e-413d-942d-a97267065c8f-config-file\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.914370 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.914293 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 19:56:53.916966 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.916947 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4vs\" (UniqueName: \"kubernetes.io/projected/6c26d246-c89e-413d-942d-a97267065c8f-kube-api-access-cm4vs\") pod \"limitador-limitador-7c9b87d574-tr4wk\" (UID: \"6c26d246-c89e-413d-942d-a97267065c8f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:53.919838 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.919819 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9vv\" (UniqueName: \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\") pod \"authorino-56c6c9ddd5-snmh8\" (UID: \"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1\") " pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:56:53.940591 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.940566 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:56:53.946671 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:53.946653 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:54.309861 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:54.309836 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:56:54.312086 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:56:54.312062 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa6ef5cf_80c2_4830_9500_e56ca5c8d6c1.slice/crio-ad3420f0279fbaa5bdd9ab1b98863587dcf2e5e00d6655345fd333d50a665aeb WatchSource:0}: Error finding container ad3420f0279fbaa5bdd9ab1b98863587dcf2e5e00d6655345fd333d50a665aeb: Status 404 returned error can't find the container with id ad3420f0279fbaa5bdd9ab1b98863587dcf2e5e00d6655345fd333d50a665aeb Nov 03 19:56:54.361083 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:54.360931 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 19:56:54.363607 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:56:54.363581 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c26d246_c89e_413d_942d_a97267065c8f.slice/crio-b630f04603dcb31b686d9c8788cc5e51ac6cb695859e9364d9abc3550c4e799f WatchSource:0}: Error finding container b630f04603dcb31b686d9c8788cc5e51ac6cb695859e9364d9abc3550c4e799f: Status 404 returned error can't find the container with id b630f04603dcb31b686d9c8788cc5e51ac6cb695859e9364d9abc3550c4e799f Nov 03 19:56:54.453273 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:54.453223 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" event={"ID":"6c26d246-c89e-413d-942d-a97267065c8f","Type":"ContainerStarted","Data":"b630f04603dcb31b686d9c8788cc5e51ac6cb695859e9364d9abc3550c4e799f"} Nov 03 19:56:54.454381 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:54.454357 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" event={"ID":"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1","Type":"ContainerStarted","Data":"ad3420f0279fbaa5bdd9ab1b98863587dcf2e5e00d6655345fd333d50a665aeb"} Nov 03 19:56:58.473624 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:58.473591 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" event={"ID":"6c26d246-c89e-413d-942d-a97267065c8f","Type":"ContainerStarted","Data":"37aa1fe6a5f273be1a788dc6579242c05f5b68580da665e35919bc541dfee73e"} Nov 03 19:56:58.474040 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:58.473714 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:56:58.475266 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:58.475229 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" event={"ID":"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1","Type":"ContainerStarted","Data":"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd"} Nov 03 19:56:58.592414 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:58.592347 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" podStartSLOduration=2.303383029 podStartE2EDuration="5.592331345s" totalImagesPullingTime="3.288948316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:58.592121892 +0000 UTC m=+360.492223701" watchObservedRunningTime="2026-11-03 19:56:58.592331345 +0000 UTC m=+360.492433150" Nov 03 19:56:58.708421 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:56:58.708374 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" podStartSLOduration=2.218138173 podStartE2EDuration="5.708360309s" totalImagesPullingTime="3.490222136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:58.707458151 +0000 UTC m=+360.607559956" watchObservedRunningTime="2026-11-03 19:56:58.708360309 +0000 UTC m=+360.608462114" Nov 03 19:57:09.479711 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:57:09.479685 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-tr4wk" Nov 03 19:57:10.753706 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:57:10.753662 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:57:40.753908 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:57:40.753822 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:58:01.535705 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.535671 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7"] Nov 03 19:58:01.537786 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.537757 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.650375 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.650338 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7"] Nov 03 19:58:01.684368 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684338 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684548 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684374 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684548 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684396 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684548 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684473 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684676 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684577 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684676 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684606 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj4v8\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-kube-api-access-hj4v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.684774 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.684682 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785492 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785456 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785502 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785529 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785678 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785662 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785865 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785734 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785865 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785769 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.785865 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.785796 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj4v8\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-kube-api-access-hj4v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.786873 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.786842 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.788345 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.788321 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.788466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.788347 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.788466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.788381 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.788466 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.788388 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.849138 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.849099 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:01.849376 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:01.849358 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj4v8\" (UniqueName: \"kubernetes.io/projected/a8542627-be0b-4b94-beaa-8fc8f4f4fccc-kube-api-access-hj4v8\") pod \"istiod-openshift-gateway-7ddd9cfdc8-86dq7\" (UID: \"a8542627-be0b-4b94-beaa-8fc8f4f4fccc\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:02.147192 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.147110 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:02.569657 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.569628 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7"] Nov 03 19:58:02.572139 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:58:02.572113 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8542627_be0b_4b94_beaa_8fc8f4f4fccc.slice/crio-4d2a8f6cde7678f10bd9d20c37507c5a92eab23a1125307897f0d4a4cee76cd4 WatchSource:0}: Error finding container 4d2a8f6cde7678f10bd9d20c37507c5a92eab23a1125307897f0d4a4cee76cd4: Status 404 returned error can't find the container with id 4d2a8f6cde7678f10bd9d20c37507c5a92eab23a1125307897f0d4a4cee76cd4 Nov 03 19:58:02.574205 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.574170 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 19:58:02.574306 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.574256 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 19:58:02.715921 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.715887 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" event={"ID":"a8542627-be0b-4b94-beaa-8fc8f4f4fccc","Type":"ContainerStarted","Data":"0e64dc3699c21e58d4211e277b8ae098d77b60c5bef481eb1711f3d742b8ae33"} Nov 03 19:58:02.716079 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.715933 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" event={"ID":"a8542627-be0b-4b94-beaa-8fc8f4f4fccc","Type":"ContainerStarted","Data":"4d2a8f6cde7678f10bd9d20c37507c5a92eab23a1125307897f0d4a4cee76cd4"} Nov 03 19:58:02.716079 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.716006 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:02.839707 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:02.839603 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" podStartSLOduration=1.839588013 podStartE2EDuration="1.839588013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:58:02.839159213 +0000 UTC m=+424.739261061" watchObservedRunningTime="2026-11-03 19:58:02.839588013 +0000 UTC m=+424.739689815" Nov 03 19:58:03.723840 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:03.723809 4456 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-86dq7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 19:58:03.724577 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:03.724531 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" podUID="a8542627-be0b-4b94-beaa-8fc8f4f4fccc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 19:58:06.723377 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:06.723340 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-86dq7" Nov 03 19:58:06.910836 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:06.910789 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:58:06.911203 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:06.911153 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" containerID="cri-o://954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462" gracePeriod=30 Nov 03 19:58:07.150970 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.150943 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:58:07.231571 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231541 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.231737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231585 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.231737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231607 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.231737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231634 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.231737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231664 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.231737 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.231681 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.232102 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.232072 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:58:07.234021 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.233994 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "kube-api-access-l7z72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:58:07.234449 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.234419 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:58:07.234525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.234463 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:58:07.234525 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.234491 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:58:07.234713 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.234696 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:58:07.332991 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.332957 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\") pod \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\" (UID: \"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2\") " Nov 03 19:58:07.333137 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333097 4456 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-cacerts\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.333137 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333113 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7z72\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-kube-api-access-l7z72\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.333137 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333122 4456 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-local-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.333137 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333133 4456 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-ca-configmap\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.333314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333142 4456 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-csr-dns-cert\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.333314 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.333151 4456 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-token\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.335047 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.335025 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig" pod "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" (UID: "3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:58:07.340264 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.340230 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-f52jn"] Nov 03 19:58:07.340521 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.340510 4456 cpu_manager.go:414] "containerMap: removing container" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" Nov 03 19:58:07.340562 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.340523 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" Nov 03 19:58:07.340594 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.340580 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerName="discovery" Nov 03 19:58:07.342390 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.342376 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.396355 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.396327 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 19:58:07.396484 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.396417 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 19:58:07.396484 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.396449 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dcsnj\"" Nov 03 19:58:07.396484 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.396453 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Nov 03 19:58:07.396607 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.396523 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Nov 03 19:58:07.401371 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.401346 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-f52jn"] Nov 03 19:58:07.433508 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.433475 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-cert\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.433659 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.433516 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-metrics-certs\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.433659 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.433540 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclnx\" (UniqueName: \"kubernetes.io/projected/50422f88-51d3-42c9-ae7a-1b643ded72a1-kube-api-access-vclnx\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.433754 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.433690 4456 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2-istio-kubeconfig\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:58:07.534178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.534088 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-cert\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.534178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.534134 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-metrics-certs\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.534178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.534158 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclnx\" (UniqueName: \"kubernetes.io/projected/50422f88-51d3-42c9-ae7a-1b643ded72a1-kube-api-access-vclnx\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.536717 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.536694 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-cert\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.536814 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.536726 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50422f88-51d3-42c9-ae7a-1b643ded72a1-metrics-certs\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.596227 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.596192 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclnx\" (UniqueName: \"kubernetes.io/projected/50422f88-51d3-42c9-ae7a-1b643ded72a1-kube-api-access-vclnx\") pod \"odh-model-controller-769875db56-f52jn\" (UID: \"50422f88-51d3-42c9-ae7a-1b643ded72a1\") " pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.653334 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.653306 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:07.739952 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.739921 4456 generic.go:356] "Generic (PLEG): container finished" podID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" containerID="954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462" exitCode=0 Nov 03 19:58:07.740333 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.739966 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" Nov 03 19:58:07.740333 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.739996 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" event={"ID":"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2","Type":"ContainerDied","Data":"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462"} Nov 03 19:58:07.740333 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.740041 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4" event={"ID":"3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2","Type":"ContainerDied","Data":"187fdfe92efd47c6b269eb3903ff10ce5bdea03e0d8cb212a69c007ba7036fe4"} Nov 03 19:58:07.740333 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.740072 4456 scope.go:122] "RemoveContainer" containerID="954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462" Nov 03 19:58:07.749032 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.749015 4456 scope.go:122] "RemoveContainer" containerID="954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462" Nov 03 19:58:07.749401 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:07.749382 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462\": container with ID starting with 954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462 not found: ID does not exist" containerID="954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462" Nov 03 19:58:07.749485 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.749409 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462"} err="failed to get container status \"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462\": rpc error: code = NotFound desc = could not find container \"954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462\": container with ID starting with 954830ff2692010bff01f2c1c29e5142a337a2cf2530430c5366e98f9b52f462 not found: ID does not exist" Nov 03 19:58:07.909359 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.909286 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:58:07.916352 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:07.916327 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-gnvm4"] Nov 03 19:58:08.022100 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:08.022078 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-f52jn"] Nov 03 19:58:08.024371 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:58:08.024348 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50422f88_51d3_42c9_ae7a_1b643ded72a1.slice/crio-2f09d0e9289b3ab6d4192903b3d52bfacb9bcd66824c61e5460ac6f5ac57dd27 WatchSource:0}: Error finding container 2f09d0e9289b3ab6d4192903b3d52bfacb9bcd66824c61e5460ac6f5ac57dd27: Status 404 returned error can't find the container with id 2f09d0e9289b3ab6d4192903b3d52bfacb9bcd66824c61e5460ac6f5ac57dd27 Nov 03 19:58:08.215744 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:08.215677 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2" path="/var/lib/kubelet/pods/3d3fbb2d-1d8d-456e-ae33-5f86d498eaf2/volumes" Nov 03 19:58:08.744922 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:08.744890 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-f52jn" event={"ID":"50422f88-51d3-42c9-ae7a-1b643ded72a1","Type":"ContainerStarted","Data":"2f09d0e9289b3ab6d4192903b3d52bfacb9bcd66824c61e5460ac6f5ac57dd27"} Nov 03 19:58:10.758333 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:10.758300 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:58:11.760779 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:11.760748 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-f52jn" event={"ID":"50422f88-51d3-42c9-ae7a-1b643ded72a1","Type":"ContainerStarted","Data":"f67c931b43d91168aca8a17dcefcdca3acd71e09d4b7a3788c5901ee9e153682"} Nov 03 19:58:11.761227 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:11.760874 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:11.884557 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:11.884510 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-f52jn" podStartSLOduration=1.780360991 podStartE2EDuration="4.884493095s" totalImagesPullingTime="3.104132104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:58:11.884284349 +0000 UTC m=+433.784386341" watchObservedRunningTime="2026-11-03 19:58:11.884493095 +0000 UTC m=+433.784594901" Nov 03 19:58:22.768557 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:22.768522 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-f52jn" Nov 03 19:58:40.753522 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:40.753487 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:58:44.721167 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.721132 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:58:44.724492 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.724475 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.777801 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.777766 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Nov 03 19:58:44.777947 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.777874 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Nov 03 19:58:44.821442 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.821409 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.821605 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.821576 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8pg\" (UniqueName: \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.821680 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.821642 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.828838 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.828815 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-t27mw\"" Nov 03 19:58:44.828966 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.828921 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Nov 03 19:58:44.830220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.830199 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:58:44.922610 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.922579 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8pg\" (UniqueName: \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.922610 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.922610 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.922791 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.922630 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.925105 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.925084 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.925219 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.925124 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:44.985958 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:44.985935 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8pg\" (UniqueName: \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\") pod \"maas-controller-64ddf68ff-xlhkx\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:45.036919 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.036891 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:45.324691 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.324617 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f6976955-8fvl7"] Nov 03 19:58:45.328031 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.328014 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.387684 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.387658 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6976955-8fvl7"] Nov 03 19:58:45.426493 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.426467 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-webhook-cert\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.426617 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.426500 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-metrics-certs\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.426617 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.426528 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzd4s\" (UniqueName: \"kubernetes.io/projected/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-kube-api-access-jzd4s\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.450535 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.450501 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:58:45.452690 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:58:45.452666 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b69d76_22d9_4b28_b483_35221da877b5.slice/crio-f68328a1bfbdaa38a2c25ff6cd596df076b683c0b4690c2f10fa03291f753d28 WatchSource:0}: Error finding container f68328a1bfbdaa38a2c25ff6cd596df076b683c0b4690c2f10fa03291f753d28: Status 404 returned error can't find the container with id f68328a1bfbdaa38a2c25ff6cd596df076b683c0b4690c2f10fa03291f753d28 Nov 03 19:58:45.527872 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.527840 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-webhook-cert\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.528002 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.527875 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-metrics-certs\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.528002 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.527905 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzd4s\" (UniqueName: \"kubernetes.io/projected/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-kube-api-access-jzd4s\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.530513 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.530492 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-metrics-certs\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.530513 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.530503 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-webhook-cert\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.590355 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.590304 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzd4s\" (UniqueName: \"kubernetes.io/projected/f0577860-f04f-4fee-b29b-4e1bc2fdcc48-kube-api-access-jzd4s\") pod \"maas-controller-8f6976955-8fvl7\" (UID: \"f0577860-f04f-4fee-b29b-4e1bc2fdcc48\") " pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.640147 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.640125 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:45.898972 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:45.898900 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" event={"ID":"b5b69d76-22d9-4b28-b483-35221da877b5","Type":"ContainerStarted","Data":"f68328a1bfbdaa38a2c25ff6cd596df076b683c0b4690c2f10fa03291f753d28"} Nov 03 19:58:46.010178 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:46.010156 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f6976955-8fvl7"] Nov 03 19:58:46.012471 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:58:46.012441 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0577860_f04f_4fee_b29b_4e1bc2fdcc48.slice/crio-a6c74280e2701a28f1d46e3ac819d9aa7e51dee6c70c8a2088f3c94d4d59197a WatchSource:0}: Error finding container a6c74280e2701a28f1d46e3ac819d9aa7e51dee6c70c8a2088f3c94d4d59197a: Status 404 returned error can't find the container with id a6c74280e2701a28f1d46e3ac819d9aa7e51dee6c70c8a2088f3c94d4d59197a Nov 03 19:58:46.903357 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:46.903321 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6976955-8fvl7" event={"ID":"f0577860-f04f-4fee-b29b-4e1bc2fdcc48","Type":"ContainerStarted","Data":"a6c74280e2701a28f1d46e3ac819d9aa7e51dee6c70c8a2088f3c94d4d59197a"} Nov 03 19:58:52.929766 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:52.929734 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f6976955-8fvl7" event={"ID":"f0577860-f04f-4fee-b29b-4e1bc2fdcc48","Type":"ContainerStarted","Data":"1ee4fe6782863b280095e83d51e6ec7945fb42146dc207d67da0823939da776a"} Nov 03 19:58:52.930197 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:52.929854 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:58:52.931159 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:52.931137 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" event={"ID":"b5b69d76-22d9-4b28-b483-35221da877b5","Type":"ContainerStarted","Data":"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a"} Nov 03 19:58:52.931321 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:52.931286 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:58:53.052658 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:53.052602 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8f6976955-8fvl7" podStartSLOduration=1.723303085 podStartE2EDuration="8.052587583s" totalImagesPullingTime="6.329284498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:58:53.050755838 +0000 UTC m=+474.950857644" watchObservedRunningTime="2026-11-03 19:58:53.052587583 +0000 UTC m=+474.952689388" Nov 03 19:58:53.172483 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:53.172424 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" podStartSLOduration=2.375905941 podStartE2EDuration="9.172404295s" totalImagesPullingTime="6.796498354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:58:53.17232773 +0000 UTC m=+475.072429537" watchObservedRunningTime="2026-11-03 19:58:53.172404295 +0000 UTC m=+475.072506079" Nov 03 19:58:56.101735 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.101699 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc"] Nov 03 19:58:56.104997 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.104981 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.159327 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.159303 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-2gdss\"" Nov 03 19:58:56.161912 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.161891 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Nov 03 19:58:56.210522 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.210477 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Nov 03 19:58:56.210522 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.210503 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Nov 03 19:58:56.217027 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.217003 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc"] Nov 03 19:58:56.217160 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.217102 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.217160 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.217146 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/7892e5a1-87aa-42fa-89d3-90438409c516-kube-api-access-mgk4g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.217250 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.217172 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.217250 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.217194 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.318025 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.317993 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.318200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.318072 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.318200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.318137 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/7892e5a1-87aa-42fa-89d3-90438409c516-kube-api-access-mgk4g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.318200 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.318194 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.318453 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:56.318430 4456 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Nov 03 19:58:56.318453 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:56.318442 4456 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found Nov 03 19:58:56.318585 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:56.318505 4456 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert podName:7892e5a1-87aa-42fa-89d3-90438409c516 nodeName:}" failed. No retries permitted until 2026-11-03 19:58:56.818482695 +0000 UTC m=+478.718584493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" (UID: "7892e5a1-87aa-42fa-89d3-90438409c516") : secret "usage-logs-tenancy-proxy-tls" not found Nov 03 19:58:56.318585 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:58:56.318530 4456 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source podName:7892e5a1-87aa-42fa-89d3-90438409c516 nodeName:}" failed. No retries permitted until 2026-11-03 19:58:56.818518659 +0000 UTC m=+478.718620459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" (UID: "7892e5a1-87aa-42fa-89d3-90438409c516") : configmap "usage-tenancy-proxy-source" not found Nov 03 19:58:56.318746 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.318728 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.382683 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.382611 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgk4g\" (UniqueName: \"kubernetes.io/projected/7892e5a1-87aa-42fa-89d3-90438409c516-kube-api-access-mgk4g\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.822585 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.822549 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.822736 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.822593 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.823505 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.823485 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/7892e5a1-87aa-42fa-89d3-90438409c516-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:56.825157 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:56.825136 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7892e5a1-87aa-42fa-89d3-90438409c516-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-hcbgc\" (UID: \"7892e5a1-87aa-42fa-89d3-90438409c516\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:57.017246 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:57.017214 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:58:57.389716 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:57.389693 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc"] Nov 03 19:58:57.392042 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:58:57.392010 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7892e5a1_87aa_42fa_89d3_90438409c516.slice/crio-d89e736a5f11e6321daffd914a1fa8f3b6fdfc263910dc681104b84224184e14 WatchSource:0}: Error finding container d89e736a5f11e6321daffd914a1fa8f3b6fdfc263910dc681104b84224184e14: Status 404 returned error can't find the container with id d89e736a5f11e6321daffd914a1fa8f3b6fdfc263910dc681104b84224184e14 Nov 03 19:58:57.951352 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:58:57.951320 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" event={"ID":"7892e5a1-87aa-42fa-89d3-90438409c516","Type":"ContainerStarted","Data":"d89e736a5f11e6321daffd914a1fa8f3b6fdfc263910dc681104b84224184e14"} Nov 03 19:59:03.938445 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:03.937752 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:59:03.938924 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:03.938455 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f6976955-8fvl7" Nov 03 19:59:04.112874 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.112833 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:59:04.113225 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.113167 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" podUID="b5b69d76-22d9-4b28-b483-35221da877b5" containerName="manager" containerID="cri-o://dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a" gracePeriod=30 Nov 03 19:59:04.855695 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.855670 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:59:04.984818 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.984786 4456 generic.go:356] "Generic (PLEG): container finished" podID="b5b69d76-22d9-4b28-b483-35221da877b5" containerID="dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a" exitCode=0 Nov 03 19:59:04.985279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.984827 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" Nov 03 19:59:04.985279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.984861 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" event={"ID":"b5b69d76-22d9-4b28-b483-35221da877b5","Type":"ContainerDied","Data":"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a"} Nov 03 19:59:04.985279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.984927 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ddf68ff-xlhkx" event={"ID":"b5b69d76-22d9-4b28-b483-35221da877b5","Type":"ContainerDied","Data":"f68328a1bfbdaa38a2c25ff6cd596df076b683c0b4690c2f10fa03291f753d28"} Nov 03 19:59:04.985279 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.984961 4456 scope.go:122] "RemoveContainer" containerID="dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a" Nov 03 19:59:04.991325 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.991297 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\" (UniqueName: \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\") pod \"b5b69d76-22d9-4b28-b483-35221da877b5\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " Nov 03 19:59:04.991469 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.991367 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\") pod \"b5b69d76-22d9-4b28-b483-35221da877b5\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " Nov 03 19:59:04.991469 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.991413 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\") pod \"b5b69d76-22d9-4b28-b483-35221da877b5\" (UID: \"b5b69d76-22d9-4b28-b483-35221da877b5\") " Nov 03 19:59:04.994270 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.994216 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg" pod "b5b69d76-22d9-4b28-b483-35221da877b5" (UID: "b5b69d76-22d9-4b28-b483-35221da877b5"). InnerVolumeSpecName "kube-api-access-mz8pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:04.994350 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.994227 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert" pod "b5b69d76-22d9-4b28-b483-35221da877b5" (UID: "b5b69d76-22d9-4b28-b483-35221da877b5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:59:04.996322 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.996302 4456 scope.go:122] "RemoveContainer" containerID="dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a" Nov 03 19:59:04.996648 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:04.996627 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a\": container with ID starting with dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a not found: ID does not exist" containerID="dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a" Nov 03 19:59:04.996773 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.996653 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a"} err="failed to get container status \"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a\": rpc error: code = NotFound desc = could not find container \"dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a\": container with ID starting with dd5448059542c640c61650e60b3c0181d85812e3ee69da12f2c8dedb21bd2b4a not found: ID does not exist" Nov 03 19:59:04.997342 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:04.997318 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs" pod "b5b69d76-22d9-4b28-b483-35221da877b5" (UID: "b5b69d76-22d9-4b28-b483-35221da877b5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:59:05.092516 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:05.092488 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8pg\" (UniqueName: \"kubernetes.io/projected/b5b69d76-22d9-4b28-b483-35221da877b5-kube-api-access-mz8pg\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:05.092516 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:05.092516 4456 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-metrics-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:05.092703 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:05.092527 4456 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5b69d76-22d9-4b28-b483-35221da877b5-webhook-cert\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:05.407875 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:05.407838 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:59:05.458742 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:05.458708 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64ddf68ff-xlhkx"] Nov 03 19:59:06.215566 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:06.215534 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5b69d76-22d9-4b28-b483-35221da877b5" path="/var/lib/kubelet/pods/b5b69d76-22d9-4b28-b483-35221da877b5/volumes" Nov 03 19:59:10.759847 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:10.759764 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:59:13.028014 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:13.027976 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" event={"ID":"7892e5a1-87aa-42fa-89d3-90438409c516","Type":"ContainerStarted","Data":"b98e4891bbdb8e7d7fb824b7ddcb1f046c17e70e02a42cc51dff84e9ecc39bcf"} Nov 03 19:59:13.028477 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:13.028099 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:59:13.149937 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:13.149876 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" podStartSLOduration=2.498750713 podStartE2EDuration="17.149857259s" totalImagesPullingTime="14.651106546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:13.148534598 +0000 UTC m=+495.048636416" watchObservedRunningTime="2026-11-03 19:59:13.149857259 +0000 UTC m=+495.049959066" Nov 03 19:59:24.036993 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:24.036961 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-hcbgc" Nov 03 19:59:25.872716 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:25.872680 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:25.873092 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:25.873003 4456 cpu_manager.go:414] "containerMap: removing container" podUID="b5b69d76-22d9-4b28-b483-35221da877b5" containerName="manager" Nov 03 19:59:25.873092 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:25.873014 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5b69d76-22d9-4b28-b483-35221da877b5" containerName="manager" Nov 03 19:59:25.873092 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:25.873085 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5b69d76-22d9-4b28-b483-35221da877b5" containerName="manager" Nov 03 19:59:26.145285 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.145200 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:26.145422 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.145332 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.161067 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.161045 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.161181 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.161080 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.161181 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.161102 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.161282 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.161261 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzmtz\" (UniqueName: \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.199688 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.199644 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 19:59:26.199688 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.199664 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 19:59:26.250936 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.250907 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Nov 03 19:59:26.250936 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.250920 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ztcrz\"" Nov 03 19:59:26.250936 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.250907 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 03 19:59:26.262432 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.262405 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzmtz\" (UniqueName: \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.262566 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.262442 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.262635 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.262565 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.262635 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.262595 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.263173 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.263109 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.264950 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.264931 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.265037 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.264975 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.324915 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.324889 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzmtz\" (UniqueName: \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\") pod \"maas-api-7df8994846-t79gk\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.471947 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.471868 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:26.881949 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:26.881923 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:26.884060 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:59:26.884033 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7280974e_f2ba_4c29_a551_b3f0d0c3e07e.slice/crio-019db205a78ad8426fca7cd683e9036747a08368b52aae0c60e027ffc1120907 WatchSource:0}: Error finding container 019db205a78ad8426fca7cd683e9036747a08368b52aae0c60e027ffc1120907: Status 404 returned error can't find the container with id 019db205a78ad8426fca7cd683e9036747a08368b52aae0c60e027ffc1120907 Nov 03 19:59:27.083386 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:27.083349 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" event={"ID":"7280974e-f2ba-4c29-a551-b3f0d0c3e07e","Type":"ContainerStarted","Data":"019db205a78ad8426fca7cd683e9036747a08368b52aae0c60e027ffc1120907"} Nov 03 19:59:31.383321 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:31.383287 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 19:59:34.112632 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:34.112595 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" event={"ID":"7280974e-f2ba-4c29-a551-b3f0d0c3e07e","Type":"ContainerStarted","Data":"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d"} Nov 03 19:59:34.113018 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:34.112708 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:34.233932 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:34.233886 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" podStartSLOduration=2.204300374 podStartE2EDuration="9.23387336s" totalImagesPullingTime="7.029572986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:34.232969942 +0000 UTC m=+516.133071748" watchObservedRunningTime="2026-11-03 19:59:34.23387336 +0000 UTC m=+516.133975166" Nov 03 19:59:40.121339 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:40.121306 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:40.753623 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:40.753591 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 19:59:41.417491 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.417458 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:41.419415 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.419399 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:41.477932 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.477899 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:41.479773 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.479750 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fl48\" (UniqueName: \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\") pod \"authorino-6f6944bcdd-l8dlh\" (UID: \"e70e6bfc-5146-485f-b259-fc7f886c032a\") " pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:41.580654 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.580625 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fl48\" (UniqueName: \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\") pod \"authorino-6f6944bcdd-l8dlh\" (UID: \"e70e6bfc-5146-485f-b259-fc7f886c032a\") " pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:41.643101 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.643069 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fl48\" (UniqueName: \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\") pod \"authorino-6f6944bcdd-l8dlh\" (UID: \"e70e6bfc-5146-485f-b259-fc7f886c032a\") " pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:41.729432 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.729353 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:41.778358 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.778321 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:41.805729 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.805703 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:41.808436 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.808418 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:41.865797 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.865765 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:41.882424 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.882395 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkps9\" (UniqueName: \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\") pod \"authorino-d6cffbf65-vwchz\" (UID: \"00955a4d-7b5c-405f-ae28-0c661880f974\") " pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:41.983787 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:41.983723 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkps9\" (UniqueName: \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\") pod \"authorino-d6cffbf65-vwchz\" (UID: \"00955a4d-7b5c-405f-ae28-0c661880f974\") " pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:42.047705 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.047680 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkps9\" (UniqueName: \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\") pod \"authorino-d6cffbf65-vwchz\" (UID: \"00955a4d-7b5c-405f-ae28-0c661880f974\") " pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:42.098149 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.098108 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:42.100327 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:59:42.100300 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode70e6bfc_5146_485f_b259_fc7f886c032a.slice/crio-83c77fd230a0fa6b86c85710f6c6c2b9b689f3ab130fb277b2516da5ee14a81d WatchSource:0}: Error finding container 83c77fd230a0fa6b86c85710f6c6c2b9b689f3ab130fb277b2516da5ee14a81d: Status 404 returned error can't find the container with id 83c77fd230a0fa6b86c85710f6c6c2b9b689f3ab130fb277b2516da5ee14a81d Nov 03 19:59:42.119207 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.119185 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:42.144106 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.144064 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" event={"ID":"e70e6bfc-5146-485f-b259-fc7f886c032a","Type":"ContainerStarted","Data":"83c77fd230a0fa6b86c85710f6c6c2b9b689f3ab130fb277b2516da5ee14a81d"} Nov 03 19:59:42.258143 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.258068 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:42.290542 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.290516 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 19:59:42.292722 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.292707 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.346081 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.346048 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 03 19:59:42.351020 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.350997 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 19:59:42.387765 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.387732 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.387892 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.387788 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbb82\" (UniqueName: \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.489194 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.489155 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.489694 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.489259 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbb82\" (UniqueName: \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.491122 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.491099 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:42.492098 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.492079 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.493720 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:59:42.493698 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00955a4d_7b5c_405f_ae28_0c661880f974.slice/crio-ffd1353d8a069cd31d03dc02c95785088f850e0686680828b53bd7ee8d17a3bc WatchSource:0}: Error finding container ffd1353d8a069cd31d03dc02c95785088f850e0686680828b53bd7ee8d17a3bc: Status 404 returned error can't find the container with id ffd1353d8a069cd31d03dc02c95785088f850e0686680828b53bd7ee8d17a3bc Nov 03 19:59:42.551822 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.551761 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbb82\" (UniqueName: \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\") pod \"authorino-67fb44bc55-2x7gn\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.603013 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.602987 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 19:59:42.969820 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:42.969794 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 19:59:42.971940 ip-10-0-134-71 kubenswrapper[4456]: W1103 19:59:42.971917 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d646f2c_bf71_41fe_b8e4_a2a751a01d55.slice/crio-76b9a6cdf3d023e17c8620a06eb5786c5ff7fa610bf0b7738a820a0288f4e2b8 WatchSource:0}: Error finding container 76b9a6cdf3d023e17c8620a06eb5786c5ff7fa610bf0b7738a820a0288f4e2b8: Status 404 returned error can't find the container with id 76b9a6cdf3d023e17c8620a06eb5786c5ff7fa610bf0b7738a820a0288f4e2b8 Nov 03 19:59:43.150694 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:43.150654 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cffbf65-vwchz" event={"ID":"00955a4d-7b5c-405f-ae28-0c661880f974","Type":"ContainerStarted","Data":"ffd1353d8a069cd31d03dc02c95785088f850e0686680828b53bd7ee8d17a3bc"} Nov 03 19:59:43.151894 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:43.151860 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" event={"ID":"2d646f2c-bf71-41fe-b8e4-a2a751a01d55","Type":"ContainerStarted","Data":"76b9a6cdf3d023e17c8620a06eb5786c5ff7fa610bf0b7738a820a0288f4e2b8"} Nov 03 19:59:44.158024 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.157988 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" event={"ID":"e70e6bfc-5146-485f-b259-fc7f886c032a","Type":"ContainerStarted","Data":"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819"} Nov 03 19:59:44.158478 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.158047 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" podUID="e70e6bfc-5146-485f-b259-fc7f886c032a" containerName="authorino" containerID="cri-o://0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819" gracePeriod=30 Nov 03 19:59:44.276055 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.275998 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" podStartSLOduration=1.6831161780000001 podStartE2EDuration="3.27598389s" totalImagesPullingTime="1.592867712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:44.274471083 +0000 UTC m=+526.174572886" watchObservedRunningTime="2026-11-03 19:59:44.27598389 +0000 UTC m=+526.176085695" Nov 03 19:59:44.409441 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.409396 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:44.504558 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.504530 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\" (UniqueName: \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\") pod \"e70e6bfc-5146-485f-b259-fc7f886c032a\" (UID: \"e70e6bfc-5146-485f-b259-fc7f886c032a\") " Nov 03 19:59:44.506790 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.506770 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48" pod "e70e6bfc-5146-485f-b259-fc7f886c032a" (UID: "e70e6bfc-5146-485f-b259-fc7f886c032a"). InnerVolumeSpecName "kube-api-access-6fl48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:44.605609 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:44.605579 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fl48\" (UniqueName: \"kubernetes.io/projected/e70e6bfc-5146-485f-b259-fc7f886c032a-kube-api-access-6fl48\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:45.166286 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.166221 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cffbf65-vwchz" event={"ID":"00955a4d-7b5c-405f-ae28-0c661880f974","Type":"ContainerStarted","Data":"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b"} Nov 03 19:59:45.166725 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.166303 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-d6cffbf65-vwchz" podUID="00955a4d-7b5c-405f-ae28-0c661880f974" containerName="authorino" containerID="cri-o://59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b" gracePeriod=30 Nov 03 19:59:45.168337 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.168311 4456 generic.go:356] "Generic (PLEG): container finished" podID="e70e6bfc-5146-485f-b259-fc7f886c032a" containerID="0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819" exitCode=0 Nov 03 19:59:45.168454 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.168369 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" Nov 03 19:59:45.168454 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.168395 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" event={"ID":"e70e6bfc-5146-485f-b259-fc7f886c032a","Type":"ContainerDied","Data":"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819"} Nov 03 19:59:45.168454 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.168427 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-l8dlh" event={"ID":"e70e6bfc-5146-485f-b259-fc7f886c032a","Type":"ContainerDied","Data":"83c77fd230a0fa6b86c85710f6c6c2b9b689f3ab130fb277b2516da5ee14a81d"} Nov 03 19:59:45.168454 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.168449 4456 scope.go:122] "RemoveContainer" containerID="0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819" Nov 03 19:59:45.175761 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.175721 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" event={"ID":"2d646f2c-bf71-41fe-b8e4-a2a751a01d55","Type":"ContainerStarted","Data":"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331"} Nov 03 19:59:45.181582 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.181352 4456 scope.go:122] "RemoveContainer" containerID="0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819" Nov 03 19:59:45.181943 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:45.181922 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819\": container with ID starting with 0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819 not found: ID does not exist" containerID="0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819" Nov 03 19:59:45.182013 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.181954 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819"} err="failed to get container status \"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819\": rpc error: code = NotFound desc = could not find container \"0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819\": container with ID starting with 0a9291ed774c86588696b1e79153f65fb787a005a0b946eec8a6669b1eaee819 not found: ID does not exist" Nov 03 19:59:45.283406 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.283049 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d6cffbf65-vwchz" podStartSLOduration=2.37764659 podStartE2EDuration="4.283032207s" totalImagesPullingTime="1.905385617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:45.282989078 +0000 UTC m=+527.183090884" watchObservedRunningTime="2026-11-03 19:59:45.283032207 +0000 UTC m=+527.183134012" Nov 03 19:59:45.401460 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.397386 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:45.403793 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.403764 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-l8dlh"] Nov 03 19:59:45.421420 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.421367 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:45.512901 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.512868 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\" (UniqueName: \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\") pod \"00955a4d-7b5c-405f-ae28-0c661880f974\" (UID: \"00955a4d-7b5c-405f-ae28-0c661880f974\") " Nov 03 19:59:45.514948 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.514925 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9" pod "00955a4d-7b5c-405f-ae28-0c661880f974" (UID: "00955a4d-7b5c-405f-ae28-0c661880f974"). InnerVolumeSpecName "kube-api-access-nkps9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:45.520119 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.520065 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" podStartSLOduration=2.083728899 podStartE2EDuration="3.520047626s" totalImagesPullingTime="1.436318727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:45.51913778 +0000 UTC m=+527.419239586" watchObservedRunningTime="2026-11-03 19:59:45.520047626 +0000 UTC m=+527.420149433" Nov 03 19:59:45.546444 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.546413 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:59:45.546625 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.546599 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" podUID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" containerName="authorino" containerID="cri-o://bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd" gracePeriod=30 Nov 03 19:59:45.613769 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.613726 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkps9\" (UniqueName: \"kubernetes.io/projected/00955a4d-7b5c-405f-ae28-0c661880f974-kube-api-access-nkps9\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:45.794076 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.794048 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:59:45.916040 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.916009 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\" (UniqueName: \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\") pod \"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1\" (UID: \"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1\") " Nov 03 19:59:45.918324 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:45.918291 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv" pod "aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" (UID: "aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1"). InnerVolumeSpecName "kube-api-access-gb9vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:46.017523 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.017498 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb9vv\" (UniqueName: \"kubernetes.io/projected/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1-kube-api-access-gb9vv\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:46.181140 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.181110 4456 generic.go:356] "Generic (PLEG): container finished" podID="00955a4d-7b5c-405f-ae28-0c661880f974" containerID="59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b" exitCode=0 Nov 03 19:59:46.181602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.181154 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d6cffbf65-vwchz" Nov 03 19:59:46.181602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.181195 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cffbf65-vwchz" event={"ID":"00955a4d-7b5c-405f-ae28-0c661880f974","Type":"ContainerDied","Data":"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b"} Nov 03 19:59:46.181602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.181258 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d6cffbf65-vwchz" event={"ID":"00955a4d-7b5c-405f-ae28-0c661880f974","Type":"ContainerDied","Data":"ffd1353d8a069cd31d03dc02c95785088f850e0686680828b53bd7ee8d17a3bc"} Nov 03 19:59:46.181602 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.181285 4456 scope.go:122] "RemoveContainer" containerID="59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b" Nov 03 19:59:46.183507 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.183484 4456 generic.go:356] "Generic (PLEG): container finished" podID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" containerID="bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd" exitCode=0 Nov 03 19:59:46.183603 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.183524 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" Nov 03 19:59:46.183603 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.183563 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" event={"ID":"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1","Type":"ContainerDied","Data":"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd"} Nov 03 19:59:46.183603 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.183595 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-snmh8" event={"ID":"aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1","Type":"ContainerDied","Data":"ad3420f0279fbaa5bdd9ab1b98863587dcf2e5e00d6655345fd333d50a665aeb"} Nov 03 19:59:46.191748 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.191730 4456 scope.go:122] "RemoveContainer" containerID="59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b" Nov 03 19:59:46.192013 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:46.191995 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b\": container with ID starting with 59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b not found: ID does not exist" containerID="59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b" Nov 03 19:59:46.192065 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.192019 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b"} err="failed to get container status \"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b\": rpc error: code = NotFound desc = could not find container \"59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b\": container with ID starting with 59da74546f0ead65a7b0eb97af68f1ffcc51a42f9e8842218667600fcfa0013b not found: ID does not exist" Nov 03 19:59:46.192065 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.192035 4456 scope.go:122] "RemoveContainer" containerID="bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd" Nov 03 19:59:46.199769 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.199752 4456 scope.go:122] "RemoveContainer" containerID="bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd" Nov 03 19:59:46.200006 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:46.199990 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd\": container with ID starting with bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd not found: ID does not exist" containerID="bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd" Nov 03 19:59:46.200059 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.200012 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd"} err="failed to get container status \"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd\": rpc error: code = NotFound desc = could not find container \"bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd\": container with ID starting with bef80a01bbbd52d7d3315dbd6eb42026d03f5cf10f6a4f2bd5414dcb700a99dd not found: ID does not exist" Nov 03 19:59:46.214795 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.214772 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e70e6bfc-5146-485f-b259-fc7f886c032a" path="/var/lib/kubelet/pods/e70e6bfc-5146-485f-b259-fc7f886c032a/volumes" Nov 03 19:59:46.349396 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.349318 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:46.353220 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.353198 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d6cffbf65-vwchz"] Nov 03 19:59:46.464707 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.464675 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:59:46.468856 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:46.468833 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-snmh8"] Nov 03 19:59:48.216422 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:48.216388 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00955a4d-7b5c-405f-ae28-0c661880f974" path="/var/lib/kubelet/pods/00955a4d-7b5c-405f-ae28-0c661880f974/volumes" Nov 03 19:59:48.216805 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:48.216710 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" path="/var/lib/kubelet/pods/aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1/volumes" Nov 03 19:59:52.177906 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.177870 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:52.178328 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.178119 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" podUID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" containerName="maas-api" containerID="cri-o://c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d" gracePeriod=30 Nov 03 19:59:52.418756 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.418733 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:52.470103 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.470045 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\") pod \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " Nov 03 19:59:52.470103 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.470093 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\") pod \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " Nov 03 19:59:52.470255 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.470174 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\") pod \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " Nov 03 19:59:52.470255 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.470202 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\" (UniqueName: \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\") pod \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\" (UID: \"7280974e-f2ba-4c29-a551-b3f0d0c3e07e\") " Nov 03 19:59:52.470465 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.470440 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca" pod "7280974e-f2ba-4c29-a551-b3f0d0c3e07e" (UID: "7280974e-f2ba-4c29-a551-b3f0d0c3e07e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:59:52.472441 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.472415 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs" pod "7280974e-f2ba-4c29-a551-b3f0d0c3e07e" (UID: "7280974e-f2ba-4c29-a551-b3f0d0c3e07e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:59:52.472535 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.472512 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls" pod "7280974e-f2ba-4c29-a551-b3f0d0c3e07e" (UID: "7280974e-f2ba-4c29-a551-b3f0d0c3e07e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:59:52.472610 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.472565 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz" pod "7280974e-f2ba-4c29-a551-b3f0d0c3e07e" (UID: "7280974e-f2ba-4c29-a551-b3f0d0c3e07e"). InnerVolumeSpecName "kube-api-access-xzmtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:52.570996 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.570972 4456 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-metrics-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:52.570996 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.570995 4456 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-maas-api-tls\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:52.571159 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.571005 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzmtz\" (UniqueName: \"kubernetes.io/projected/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-kube-api-access-xzmtz\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:52.571159 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:52.571015 4456 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7280974e-f2ba-4c29-a551-b3f0d0c3e07e-openshift-service-ca\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:53.214652 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.214619 4456 generic.go:356] "Generic (PLEG): container finished" podID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" containerID="c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d" exitCode=0 Nov 03 19:59:53.215119 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.214672 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" Nov 03 19:59:53.215119 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.214699 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" event={"ID":"7280974e-f2ba-4c29-a551-b3f0d0c3e07e","Type":"ContainerDied","Data":"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d"} Nov 03 19:59:53.215119 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.214745 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df8994846-t79gk" event={"ID":"7280974e-f2ba-4c29-a551-b3f0d0c3e07e","Type":"ContainerDied","Data":"019db205a78ad8426fca7cd683e9036747a08368b52aae0c60e027ffc1120907"} Nov 03 19:59:53.215119 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.214766 4456 scope.go:122] "RemoveContainer" containerID="c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d" Nov 03 19:59:53.223960 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.223941 4456 scope.go:122] "RemoveContainer" containerID="c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d" Nov 03 19:59:53.224232 ip-10-0-134-71 kubenswrapper[4456]: E1103 19:59:53.224214 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d\": container with ID starting with c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d not found: ID does not exist" containerID="c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d" Nov 03 19:59:53.224232 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.224262 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d"} err="failed to get container status \"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d\": rpc error: code = NotFound desc = could not find container \"c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d\": container with ID starting with c13437f73c9322554095ea4ae6a9a145e24e8cde2411526d45ab66359f88c86d not found: ID does not exist" Nov 03 19:59:53.386017 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.385983 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:53.436690 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:53.436668 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df8994846-t79gk"] Nov 03 19:59:54.214581 ip-10-0-134-71 kubenswrapper[4456]: I1103 19:59:54.214555 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" path="/var/lib/kubelet/pods/7280974e-f2ba-4c29-a551-b3f0d0c3e07e/volumes" Nov 03 20:00:00.174459 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174425 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174736 4456 cpu_manager.go:414] "containerMap: removing container" podUID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" containerName="maas-api" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174747 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" containerName="maas-api" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174759 4456 cpu_manager.go:414] "containerMap: removing container" podUID="00955a4d-7b5c-405f-ae28-0c661880f974" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174764 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00955a4d-7b5c-405f-ae28-0c661880f974" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174776 4456 cpu_manager.go:414] "containerMap: removing container" podUID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174781 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174788 4456 cpu_manager.go:414] "containerMap: removing container" podUID="e70e6bfc-5146-485f-b259-fc7f886c032a" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174793 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e70e6bfc-5146-485f-b259-fc7f886c032a" containerName="authorino" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174836 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="7280974e-f2ba-4c29-a551-b3f0d0c3e07e" containerName="maas-api" Nov 03 20:00:00.174843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174845 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="00955a4d-7b5c-405f-ae28-0c661880f974" containerName="authorino" Nov 03 20:00:00.175133 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174854 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa6ef5cf-80c2-4830-9500-e56ca5c8d6c1" containerName="authorino" Nov 03 20:00:00.175133 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.174860 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="e70e6bfc-5146-485f-b259-fc7f886c032a" containerName="authorino" Nov 03 20:00:00.177654 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.177636 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.233205 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.233163 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.233407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.233228 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjjm\" (UniqueName: \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.234169 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.234141 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 20:00:00.235903 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.235877 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:00.285059 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.285024 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:00:00.285059 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.285026 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 20:00:00.333890 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.333858 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.334079 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.333907 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjjm\" (UniqueName: \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.334560 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.334534 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.396861 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.396821 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjjm\" (UniqueName: \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\") pod \"maas-api-key-cleanup-29895600-p2sdb\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.488675 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.488638 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:00.857979 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:00.857953 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:00.860735 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:00:00.860706 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2e4bef_8242_443c_8f15_f5da8528fe7f.slice/crio-ea802dfd758992b88ba873d04eb6d212a095189692aaf4cdb8f833dd2e71d291 WatchSource:0}: Error finding container ea802dfd758992b88ba873d04eb6d212a095189692aaf4cdb8f833dd2e71d291: Status 404 returned error can't find the container with id ea802dfd758992b88ba873d04eb6d212a095189692aaf4cdb8f833dd2e71d291 Nov 03 20:00:01.245999 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:01.245966 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" event={"ID":"4c2e4bef-8242-443c-8f15-f5da8528fe7f","Type":"ContainerStarted","Data":"ea802dfd758992b88ba873d04eb6d212a095189692aaf4cdb8f833dd2e71d291"} Nov 03 20:00:08.272834 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:08.272805 4456 generic.go:356] "Generic (PLEG): container finished" podID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerID="3547af9aa1552506ab3c6b2e4f5b4a5676dd025dfe914acbad93ce027d4217f1" exitCode=60 Nov 03 20:00:08.273297 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:08.272838 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" event={"ID":"4c2e4bef-8242-443c-8f15-f5da8528fe7f","Type":"ContainerDied","Data":"3547af9aa1552506ab3c6b2e4f5b4a5676dd025dfe914acbad93ce027d4217f1"} Nov 03 20:00:08.273297 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:08.273068 4456 scope.go:122] "RemoveContainer" containerID="3547af9aa1552506ab3c6b2e4f5b4a5676dd025dfe914acbad93ce027d4217f1" Nov 03 20:00:09.278545 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:09.278511 4456 generic.go:356] "Generic (PLEG): container finished" podID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerID="42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591" exitCode=60 Nov 03 20:00:09.279005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:09.278603 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" event={"ID":"4c2e4bef-8242-443c-8f15-f5da8528fe7f","Type":"ContainerDied","Data":"42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591"} Nov 03 20:00:09.279005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:09.278672 4456 scope.go:122] "RemoveContainer" containerID="3547af9aa1552506ab3c6b2e4f5b4a5676dd025dfe914acbad93ce027d4217f1" Nov 03 20:00:09.279005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:09.278785 4456 scope.go:122] "RemoveContainer" containerID="42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591" Nov 03 20:00:09.279005 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:09.278995 4456 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895600-p2sdb_odh-ai-gateway-infra(4c2e4bef-8242-443c-8f15-f5da8528fe7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" Nov 03 20:00:10.283945 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:10.283914 4456 scope.go:122] "RemoveContainer" containerID="42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591" Nov 03 20:00:10.284346 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:10.284095 4456 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895600-p2sdb_odh-ai-gateway-infra(4c2e4bef-8242-443c-8f15-f5da8528fe7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" Nov 03 20:00:10.753289 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:10.753254 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:00:17.991825 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:17.991790 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:00:17.995045 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:17.995028 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.052364 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.052336 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Nov 03 20:00:18.053710 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.053685 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:00:18.182489 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.182456 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.182489 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.182495 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.182702 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.182524 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9fd\" (UniqueName: \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.283801 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.283725 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.283801 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.283767 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.283985 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.283804 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9fd\" (UniqueName: \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.284386 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.284368 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.286412 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.286393 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.346522 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.346493 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9fd\" (UniqueName: \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\") pod \"authorino-7d8bb9f59f-xv9s5\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.605640 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.605568 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:00:18.995057 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:18.977595 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:00:18.995057 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:00:18.980111 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdb08c1f_d1af_499a_a828_c6b1b81f96ad.slice/crio-de23a07cc4a1f0cc35a0abfb1857debfd9a28a74641efc798e84ae525a3b911f WatchSource:0}: Error finding container de23a07cc4a1f0cc35a0abfb1857debfd9a28a74641efc798e84ae525a3b911f: Status 404 returned error can't find the container with id de23a07cc4a1f0cc35a0abfb1857debfd9a28a74641efc798e84ae525a3b911f Nov 03 20:00:19.318227 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:19.318188 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" event={"ID":"fdb08c1f-d1af-499a-a828-c6b1b81f96ad","Type":"ContainerStarted","Data":"de23a07cc4a1f0cc35a0abfb1857debfd9a28a74641efc798e84ae525a3b911f"} Nov 03 20:00:21.211285 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:21.211231 4456 scope.go:122] "RemoveContainer" containerID="42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591" Nov 03 20:00:22.340272 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.334487 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" event={"ID":"fdb08c1f-d1af-499a-a828-c6b1b81f96ad","Type":"ContainerStarted","Data":"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19"} Nov 03 20:00:22.346216 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.346175 4456 generic.go:356] "Generic (PLEG): container finished" podID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerID="8422353912beb540fb24709e42237babbfa9d3de453b8bb5bdb148e9b4978a3b" exitCode=60 Nov 03 20:00:22.346421 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.346221 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" event={"ID":"4c2e4bef-8242-443c-8f15-f5da8528fe7f","Type":"ContainerDied","Data":"8422353912beb540fb24709e42237babbfa9d3de453b8bb5bdb148e9b4978a3b"} Nov 03 20:00:22.346421 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.346300 4456 scope.go:122] "RemoveContainer" containerID="42b9d1d7d6c253bdbd20e375a14bed4bc983905f8eaf635abdbffc9ac9f0d591" Nov 03 20:00:22.346746 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.346724 4456 scope.go:122] "RemoveContainer" containerID="8422353912beb540fb24709e42237babbfa9d3de453b8bb5bdb148e9b4978a3b" Nov 03 20:00:22.346985 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:22.346962 4456 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895600-p2sdb_odh-ai-gateway-infra(4c2e4bef-8242-443c-8f15-f5da8528fe7f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" Nov 03 20:00:22.455102 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.455042 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" podStartSLOduration=3.028412138 podStartE2EDuration="5.455029277s" totalImagesPullingTime="2.426617139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:00:22.454218107 +0000 UTC m=+564.354319913" watchObservedRunningTime="2026-11-03 20:00:22.455029277 +0000 UTC m=+564.355131083" Nov 03 20:00:22.483180 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.483148 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 20:00:22.483366 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.483347 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" podUID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" containerName="authorino" containerID="cri-o://7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331" gracePeriod=30 Nov 03 20:00:22.728883 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.728856 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 20:00:22.822521 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.822488 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\" (UniqueName: \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\") pod \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " Nov 03 20:00:22.824721 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.824694 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82" pod "2d646f2c-bf71-41fe-b8e4-a2a751a01d55" (UID: "2d646f2c-bf71-41fe-b8e4-a2a751a01d55"). InnerVolumeSpecName "kube-api-access-wbb82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:00:22.923433 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.923401 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\" (UniqueName: \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\") pod \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\" (UID: \"2d646f2c-bf71-41fe-b8e4-a2a751a01d55\") " Nov 03 20:00:22.923588 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.923552 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbb82\" (UniqueName: \"kubernetes.io/projected/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-kube-api-access-wbb82\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:00:22.933506 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:22.933479 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert" pod "2d646f2c-bf71-41fe-b8e4-a2a751a01d55" (UID: "2d646f2c-bf71-41fe-b8e4-a2a751a01d55"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:00:23.024144 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.024113 4456 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2d646f2c-bf71-41fe-b8e4-a2a751a01d55-tls-cert\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:00:23.352919 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.352890 4456 generic.go:356] "Generic (PLEG): container finished" podID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" containerID="7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331" exitCode=0 Nov 03 20:00:23.353577 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.352946 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" Nov 03 20:00:23.353577 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.352989 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" event={"ID":"2d646f2c-bf71-41fe-b8e4-a2a751a01d55","Type":"ContainerDied","Data":"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331"} Nov 03 20:00:23.353577 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.353036 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67fb44bc55-2x7gn" event={"ID":"2d646f2c-bf71-41fe-b8e4-a2a751a01d55","Type":"ContainerDied","Data":"76b9a6cdf3d023e17c8620a06eb5786c5ff7fa610bf0b7738a820a0288f4e2b8"} Nov 03 20:00:23.353577 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.353063 4456 scope.go:122] "RemoveContainer" containerID="7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331" Nov 03 20:00:23.361766 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.361743 4456 scope.go:122] "RemoveContainer" containerID="7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331" Nov 03 20:00:23.362018 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:23.362000 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331\": container with ID starting with 7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331 not found: ID does not exist" containerID="7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331" Nov 03 20:00:23.362073 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.362026 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331"} err="failed to get container status \"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331\": rpc error: code = NotFound desc = could not find container \"7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331\": container with ID starting with 7c2a01c516dee120bec5b4d795302d065c8c1d5baadaa2e1927657cf1e5ff331 not found: ID does not exist" Nov 03 20:00:23.518604 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.518577 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 20:00:23.523031 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.523010 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67fb44bc55-2x7gn"] Nov 03 20:00:23.582883 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.582862 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:23.709827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.709805 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:23.728817 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.728789 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\") pod \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " Nov 03 20:00:23.728933 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.728849 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\" (UniqueName: \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\") pod \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\" (UID: \"4c2e4bef-8242-443c-8f15-f5da8528fe7f\") " Nov 03 20:00:23.729148 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.729121 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca" pod "4c2e4bef-8242-443c-8f15-f5da8528fe7f" (UID: "4c2e4bef-8242-443c-8f15-f5da8528fe7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:00:23.730973 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.730955 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm" pod "4c2e4bef-8242-443c-8f15-f5da8528fe7f" (UID: "4c2e4bef-8242-443c-8f15-f5da8528fe7f"). InnerVolumeSpecName "kube-api-access-rwjjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:00:23.829414 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.829352 4456 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2e4bef-8242-443c-8f15-f5da8528fe7f-maas-api-service-ca\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:00:23.829414 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:23.829380 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwjjm\" (UniqueName: \"kubernetes.io/projected/4c2e4bef-8242-443c-8f15-f5da8528fe7f-kube-api-access-rwjjm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:00:24.215555 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.215483 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" path="/var/lib/kubelet/pods/2d646f2c-bf71-41fe-b8e4-a2a751a01d55/volumes" Nov 03 20:00:24.360667 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.360638 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" event={"ID":"4c2e4bef-8242-443c-8f15-f5da8528fe7f","Type":"ContainerDied","Data":"ea802dfd758992b88ba873d04eb6d212a095189692aaf4cdb8f833dd2e71d291"} Nov 03 20:00:24.361119 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.360678 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb" Nov 03 20:00:24.361119 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.360694 4456 scope.go:122] "RemoveContainer" containerID="8422353912beb540fb24709e42237babbfa9d3de453b8bb5bdb148e9b4978a3b" Nov 03 20:00:24.527696 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.527665 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:24.578516 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:24.578476 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895600-p2sdb"] Nov 03 20:00:26.215565 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:00:26.215534 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" path="/var/lib/kubelet/pods/4c2e4bef-8242-443c-8f15-f5da8528fe7f/volumes" Nov 03 20:00:40.753111 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:00:40.753024 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:01:10.753810 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:01:10.753772 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:01:16.175053 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175023 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175508 4456 cpu_manager.go:414] "containerMap: removing container" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175529 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175548 4456 cpu_manager.go:414] "containerMap: removing container" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175556 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175568 4456 cpu_manager.go:414] "containerMap: removing container" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175576 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175591 4456 cpu_manager.go:414] "containerMap: removing container" podUID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" containerName="authorino" Nov 03 20:01:16.175662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175599 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" containerName="authorino" Nov 03 20:01:16.176042 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175667 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.176042 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175678 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:16.176042 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.175698 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d646f2c-bf71-41fe-b8e4-a2a751a01d55" containerName="authorino" Nov 03 20:01:16.179051 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.179030 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.233118 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.233092 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 03 20:01:16.233281 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.233198 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 03 20:01:16.284288 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.284260 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-rjjr6\"" Nov 03 20:01:16.285499 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.285482 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:16.349633 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.349600 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.349633 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.349637 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm47p\" (UniqueName: \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.451028 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.450947 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.451028 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.450978 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm47p\" (UniqueName: \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.453542 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.453518 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.513677 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.513642 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm47p\" (UniqueName: \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\") pod \"ai-gateway-controller-5d8dddb676-xsc87\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:16.791756 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:16.791722 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:17.161731 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:17.161698 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:17.164448 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:01:17.164422 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97aa716_96c2_4a72_826f_0eabbc696fd8.slice/crio-11aaa46ec1befde71e1395f9ebdcb949ea2d5fd47af916557b8ddd1e54a86de4 WatchSource:0}: Error finding container 11aaa46ec1befde71e1395f9ebdcb949ea2d5fd47af916557b8ddd1e54a86de4: Status 404 returned error can't find the container with id 11aaa46ec1befde71e1395f9ebdcb949ea2d5fd47af916557b8ddd1e54a86de4 Nov 03 20:01:17.166101 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:17.166081 4456 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:01:17.560929 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:17.560898 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" event={"ID":"e97aa716-96c2-4a72-826f-0eabbc696fd8","Type":"ContainerStarted","Data":"11aaa46ec1befde71e1395f9ebdcb949ea2d5fd47af916557b8ddd1e54a86de4"} Nov 03 20:01:23.587347 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:23.587297 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" event={"ID":"e97aa716-96c2-4a72-826f-0eabbc696fd8","Type":"ContainerStarted","Data":"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca"} Nov 03 20:01:23.587802 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:23.587392 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:23.706426 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:23.706375 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" podStartSLOduration=1.672241653 podStartE2EDuration="7.706361425s" totalImagesPullingTime="6.034119772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:23.705993515 +0000 UTC m=+625.606095318" watchObservedRunningTime="2026-11-03 20:01:23.706361425 +0000 UTC m=+625.606463254" Nov 03 20:01:27.578787 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.578753 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2"] Nov 03 20:01:27.579181 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.579113 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c2e4bef-8242-443c-8f15-f5da8528fe7f" containerName="cleanup" Nov 03 20:01:27.581936 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.581922 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.639164 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.639135 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlgj8\" (UniqueName: \"kubernetes.io/projected/71914d47-f09e-43fa-b5d7-925b5000ca33-kube-api-access-dlgj8\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.639343 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.639177 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71914d47-f09e-43fa-b5d7-925b5000ca33-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.639602 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.639587 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Nov 03 20:01:27.689725 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.689695 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9xg5z\"" Nov 03 20:01:27.691108 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.691087 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2"] Nov 03 20:01:27.740296 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.740260 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlgj8\" (UniqueName: \"kubernetes.io/projected/71914d47-f09e-43fa-b5d7-925b5000ca33-kube-api-access-dlgj8\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.740470 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.740318 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71914d47-f09e-43fa-b5d7-925b5000ca33-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.741069 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.741045 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71914d47-f09e-43fa-b5d7-925b5000ca33-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.742002 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.741983 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-qcnxp"] Nov 03 20:01:27.745267 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.745230 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:27.790634 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.790603 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-qcnxp"] Nov 03 20:01:27.805655 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.805627 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlgj8\" (UniqueName: \"kubernetes.io/projected/71914d47-f09e-43fa-b5d7-925b5000ca33-kube-api-access-dlgj8\") pod \"payload-pre-processing-7b98bb678c-wpsp2\" (UID: \"71914d47-f09e-43fa-b5d7-925b5000ca33\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.840722 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.840647 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9271bf7d-b429-4068-abc6-2175b09b0484-plugins-config-volume\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:27.840862 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.840757 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6lf\" (UniqueName: \"kubernetes.io/projected/9271bf7d-b429-4068-abc6-2175b09b0484-kube-api-access-rd6lf\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:27.894149 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.894117 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:27.941812 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.941731 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6lf\" (UniqueName: \"kubernetes.io/projected/9271bf7d-b429-4068-abc6-2175b09b0484-kube-api-access-rd6lf\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:27.941896 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.941809 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9271bf7d-b429-4068-abc6-2175b09b0484-plugins-config-volume\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:27.942672 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:27.942624 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9271bf7d-b429-4068-abc6-2175b09b0484-plugins-config-volume\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:28.005964 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.005932 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6lf\" (UniqueName: \"kubernetes.io/projected/9271bf7d-b429-4068-abc6-2175b09b0484-kube-api-access-rd6lf\") pod \"payload-processing-7bb9489676-qcnxp\" (UID: \"9271bf7d-b429-4068-abc6-2175b09b0484\") " pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:28.057025 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.056982 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:28.265188 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.265161 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2"] Nov 03 20:01:28.267773 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:01:28.267732 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71914d47_f09e_43fa_b5d7_925b5000ca33.slice/crio-6b607d1b7d55a83ad7e6f2f6c12d8708cc8457c145d88dc3deded2fd9eedd1d8 WatchSource:0}: Error finding container 6b607d1b7d55a83ad7e6f2f6c12d8708cc8457c145d88dc3deded2fd9eedd1d8: Status 404 returned error can't find the container with id 6b607d1b7d55a83ad7e6f2f6c12d8708cc8457c145d88dc3deded2fd9eedd1d8 Nov 03 20:01:28.431683 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.431617 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-qcnxp"] Nov 03 20:01:28.434617 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:01:28.434592 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9271bf7d_b429_4068_abc6_2175b09b0484.slice/crio-536ea6c9fe3c03301de99268bbcac1f3cd45562240741836ad2262d8db095d3f WatchSource:0}: Error finding container 536ea6c9fe3c03301de99268bbcac1f3cd45562240741836ad2262d8db095d3f: Status 404 returned error can't find the container with id 536ea6c9fe3c03301de99268bbcac1f3cd45562240741836ad2262d8db095d3f Nov 03 20:01:28.606762 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.606721 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" event={"ID":"71914d47-f09e-43fa-b5d7-925b5000ca33","Type":"ContainerStarted","Data":"6b607d1b7d55a83ad7e6f2f6c12d8708cc8457c145d88dc3deded2fd9eedd1d8"} Nov 03 20:01:28.607810 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:28.607788 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" event={"ID":"9271bf7d-b429-4068-abc6-2175b09b0484","Type":"ContainerStarted","Data":"536ea6c9fe3c03301de99268bbcac1f3cd45562240741836ad2262d8db095d3f"} Nov 03 20:01:31.624135 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.624103 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" event={"ID":"9271bf7d-b429-4068-abc6-2175b09b0484","Type":"ContainerStarted","Data":"39459fbe478e3d600273128bb3f61a35066e4d389efef131f8eb6962bb6855d9"} Nov 03 20:01:31.624650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.624221 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:31.625653 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.625628 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" event={"ID":"71914d47-f09e-43fa-b5d7-925b5000ca33","Type":"ContainerStarted","Data":"41fd8aa8ba4f3fbdcad2d56cb6109dbdd864424f7121b799348ac7d5bebfe3d8"} Nov 03 20:01:31.625784 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.625770 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:31.742670 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.742614 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" podStartSLOduration=2.145053909 podStartE2EDuration="4.742599494s" totalImagesPullingTime="2.597545585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:31.742347105 +0000 UTC m=+633.642448912" watchObservedRunningTime="2026-11-03 20:01:31.742599494 +0000 UTC m=+633.642701300" Nov 03 20:01:31.862574 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:31.862516 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" podStartSLOduration=2.127411486 podStartE2EDuration="4.862501059s" totalImagesPullingTime="2.735089573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:31.861180827 +0000 UTC m=+633.761282634" watchObservedRunningTime="2026-11-03 20:01:31.862501059 +0000 UTC m=+633.762602864" Nov 03 20:01:34.593284 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:34.593226 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:34.938753 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:34.938676 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-598949b94-lwknj"] Nov 03 20:01:34.942400 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:34.942380 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.000487 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.000455 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-598949b94-lwknj"] Nov 03 20:01:35.010178 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.010144 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9533bfc-db3b-412d-b8b7-07faa97fed24-metrics-certs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.010340 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.010318 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47bs\" (UniqueName: \"kubernetes.io/projected/a9533bfc-db3b-412d-b8b7-07faa97fed24-kube-api-access-t47bs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.111640 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.111599 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47bs\" (UniqueName: \"kubernetes.io/projected/a9533bfc-db3b-412d-b8b7-07faa97fed24-kube-api-access-t47bs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.111843 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.111669 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9533bfc-db3b-412d-b8b7-07faa97fed24-metrics-certs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.114232 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.114213 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9533bfc-db3b-412d-b8b7-07faa97fed24-metrics-certs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.174055 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.174022 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47bs\" (UniqueName: \"kubernetes.io/projected/a9533bfc-db3b-412d-b8b7-07faa97fed24-kube-api-access-t47bs\") pod \"ai-gateway-controller-598949b94-lwknj\" (UID: \"a9533bfc-db3b-412d-b8b7-07faa97fed24\") " pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.254329 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.254295 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:35.626871 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.626845 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-598949b94-lwknj"] Nov 03 20:01:35.629012 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:01:35.628987 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9533bfc_db3b_412d_b8b7_07faa97fed24.slice/crio-a9968e28dff6325cf5b5c608d9037cd7a474d40ea68e4a36eb23671d5c629c21 WatchSource:0}: Error finding container a9968e28dff6325cf5b5c608d9037cd7a474d40ea68e4a36eb23671d5c629c21: Status 404 returned error can't find the container with id a9968e28dff6325cf5b5c608d9037cd7a474d40ea68e4a36eb23671d5c629c21 Nov 03 20:01:35.642989 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:35.642950 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" event={"ID":"a9533bfc-db3b-412d-b8b7-07faa97fed24","Type":"ContainerStarted","Data":"a9968e28dff6325cf5b5c608d9037cd7a474d40ea68e4a36eb23671d5c629c21"} Nov 03 20:01:36.655470 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:36.655435 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" event={"ID":"a9533bfc-db3b-412d-b8b7-07faa97fed24","Type":"ContainerStarted","Data":"0f0a795c3c9b40819e03f8e3b7d1ffb9ca3252ef0116453852ae04c5d23231a2"} Nov 03 20:01:36.655878 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:36.655536 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:36.775083 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:36.775030 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" podStartSLOduration=1.9354741629999999 podStartE2EDuration="2.775018109s" totalImagesPullingTime="839.543946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:01:36.774224404 +0000 UTC m=+638.674326209" watchObservedRunningTime="2026-11-03 20:01:36.775018109 +0000 UTC m=+638.675119961" Nov 03 20:01:40.753290 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:01:40.753232 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:01:42.632498 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:42.632473 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-qcnxp" Nov 03 20:01:42.632969 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:42.632536 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-wpsp2" Nov 03 20:01:47.661517 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:47.661482 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-598949b94-lwknj" Nov 03 20:01:47.808532 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:47.808505 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:47.808735 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:47.808707 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" podUID="e97aa716-96c2-4a72-826f-0eabbc696fd8" containerName="manager" containerID="cri-o://a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca" gracePeriod=30 Nov 03 20:01:48.057380 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.057319 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:48.124185 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.124151 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\" (UniqueName: \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\") pod \"e97aa716-96c2-4a72-826f-0eabbc696fd8\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " Nov 03 20:01:48.124409 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.124197 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\") pod \"e97aa716-96c2-4a72-826f-0eabbc696fd8\" (UID: \"e97aa716-96c2-4a72-826f-0eabbc696fd8\") " Nov 03 20:01:48.126460 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.126433 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p" pod "e97aa716-96c2-4a72-826f-0eabbc696fd8" (UID: "e97aa716-96c2-4a72-826f-0eabbc696fd8"). InnerVolumeSpecName "kube-api-access-nm47p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:01:48.126560 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.126502 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs" pod "e97aa716-96c2-4a72-826f-0eabbc696fd8" (UID: "e97aa716-96c2-4a72-826f-0eabbc696fd8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:01:48.224871 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.224847 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm47p\" (UniqueName: \"kubernetes.io/projected/e97aa716-96c2-4a72-826f-0eabbc696fd8-kube-api-access-nm47p\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:48.224871 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.224871 4456 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e97aa716-96c2-4a72-826f-0eabbc696fd8-metrics-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:01:48.702936 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.702904 4456 generic.go:356] "Generic (PLEG): container finished" podID="e97aa716-96c2-4a72-826f-0eabbc696fd8" containerID="a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca" exitCode=0 Nov 03 20:01:48.703365 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.702951 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" Nov 03 20:01:48.703365 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.702966 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" event={"ID":"e97aa716-96c2-4a72-826f-0eabbc696fd8","Type":"ContainerDied","Data":"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca"} Nov 03 20:01:48.703365 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.703006 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-xsc87" event={"ID":"e97aa716-96c2-4a72-826f-0eabbc696fd8","Type":"ContainerDied","Data":"11aaa46ec1befde71e1395f9ebdcb949ea2d5fd47af916557b8ddd1e54a86de4"} Nov 03 20:01:48.703365 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.703028 4456 scope.go:122] "RemoveContainer" containerID="a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca" Nov 03 20:01:48.711144 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.711128 4456 scope.go:122] "RemoveContainer" containerID="a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca" Nov 03 20:01:48.711460 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:01:48.711440 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca\": container with ID starting with a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca not found: ID does not exist" containerID="a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca" Nov 03 20:01:48.711509 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.711468 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca"} err="failed to get container status \"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca\": rpc error: code = NotFound desc = could not find container \"a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca\": container with ID starting with a2139f0c28774414cbc437c499c18cef6324039f8a856ddd5dc51da387043bca not found: ID does not exist" Nov 03 20:01:48.870796 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.870758 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:48.921614 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:48.921580 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-xsc87"] Nov 03 20:01:50.215794 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:50.215751 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e97aa716-96c2-4a72-826f-0eabbc696fd8" path="/var/lib/kubelet/pods/e97aa716-96c2-4a72-826f-0eabbc696fd8/volumes" Nov 03 20:01:57.598130 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.598100 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6"] Nov 03 20:01:57.598522 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.598447 4456 cpu_manager.go:414] "containerMap: removing container" podUID="e97aa716-96c2-4a72-826f-0eabbc696fd8" containerName="manager" Nov 03 20:01:57.598522 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.598461 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e97aa716-96c2-4a72-826f-0eabbc696fd8" containerName="manager" Nov 03 20:01:57.598522 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.598517 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="e97aa716-96c2-4a72-826f-0eabbc696fd8" containerName="manager" Nov 03 20:01:57.603199 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.603181 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.660027 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.659999 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 03 20:01:57.707805 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.707774 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 03 20:01:57.707966 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.707842 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6mwnm\"" Nov 03 20:01:57.707966 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.707885 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Nov 03 20:01:57.709432 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.709417 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6"] Nov 03 20:01:57.710488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710471 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.710541 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710499 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.710541 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710522 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2dcf52-884a-401c-8f18-28b36e6268fd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.710615 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710578 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.710695 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710681 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.710734 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.710703 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72p2\" (UniqueName: \"kubernetes.io/projected/fc2dcf52-884a-401c-8f18-28b36e6268fd-kube-api-access-v72p2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811373 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2dcf52-884a-401c-8f18-28b36e6268fd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811413 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811619 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811538 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811619 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811566 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72p2\" (UniqueName: \"kubernetes.io/projected/fc2dcf52-884a-401c-8f18-28b36e6268fd-kube-api-access-v72p2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811698 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811629 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811698 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811660 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811804 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811751 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.811950 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811931 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.812052 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.811997 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.813854 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.813832 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc2dcf52-884a-401c-8f18-28b36e6268fd-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.814012 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.813997 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc2dcf52-884a-401c-8f18-28b36e6268fd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.874034 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.873974 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72p2\" (UniqueName: \"kubernetes.io/projected/fc2dcf52-884a-401c-8f18-28b36e6268fd-kube-api-access-v72p2\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6\" (UID: \"fc2dcf52-884a-401c-8f18-28b36e6268fd\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:57.915006 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:57.914979 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:01:58.287731 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:58.287709 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6"] Nov 03 20:01:58.289783 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:01:58.289751 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2dcf52_884a_401c_8f18_28b36e6268fd.slice/crio-5b55777c39225fac0af15fb63219c17766799a686decc9205bebc1dcc5202c8d WatchSource:0}: Error finding container 5b55777c39225fac0af15fb63219c17766799a686decc9205bebc1dcc5202c8d: Status 404 returned error can't find the container with id 5b55777c39225fac0af15fb63219c17766799a686decc9205bebc1dcc5202c8d Nov 03 20:01:58.744914 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:01:58.744885 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" event={"ID":"fc2dcf52-884a-401c-8f18-28b36e6268fd","Type":"ContainerStarted","Data":"5b55777c39225fac0af15fb63219c17766799a686decc9205bebc1dcc5202c8d"} Nov 03 20:02:00.759706 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:00.759667 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" event={"ID":"fc2dcf52-884a-401c-8f18-28b36e6268fd","Type":"ContainerStarted","Data":"447f4d62809dd3575294d172069afb62807d094d922630616088054bb314f73b"} Nov 03 20:02:00.887380 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:00.887326 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" podStartSLOduration=1.518914119 podStartE2EDuration="3.887311796s" totalImagesPullingTime="2.368397677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:01:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:00.886322305 +0000 UTC m=+662.786424111" watchObservedRunningTime="2026-11-03 20:02:00.887311796 +0000 UTC m=+662.787413601" Nov 03 20:02:00.916392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:00.916315 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:02:01.246741 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:01.246710 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:02:04.759223 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.759189 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp"] Nov 03 20:02:04.761445 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.761429 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.815334 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.815307 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Nov 03 20:02:04.821827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.821800 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp"] Nov 03 20:02:04.878308 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878280 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.878504 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878319 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.878504 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878437 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.878504 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878484 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.878634 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878503 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.878634 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.878613 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4pd4\" (UniqueName: \"kubernetes.io/projected/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-kube-api-access-p4pd4\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979255 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979206 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979428 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979277 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979428 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979318 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979428 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979337 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979428 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979353 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979428 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979385 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4pd4\" (UniqueName: \"kubernetes.io/projected/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-kube-api-access-p4pd4\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979723 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979697 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979784 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979733 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.979784 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.979768 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.981513 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.981486 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:04.981891 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:04.981871 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:05.042444 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:05.042373 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4pd4\" (UniqueName: \"kubernetes.io/projected/e09eca27-7fbc-41cd-81c9-98e937e7a9fd-kube-api-access-p4pd4\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-2v7cp\" (UID: \"e09eca27-7fbc-41cd-81c9-98e937e7a9fd\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:05.073138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:05.073105 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:05.447283 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:05.445853 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp"] Nov 03 20:02:05.780982 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:05.780948 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" event={"ID":"e09eca27-7fbc-41cd-81c9-98e937e7a9fd","Type":"ContainerStarted","Data":"6a70685ef07c37b5049475489dd542b9a0a80f0c0ddceb1e66333c53d687dca0"} Nov 03 20:02:06.786407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:06.786367 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" event={"ID":"e09eca27-7fbc-41cd-81c9-98e937e7a9fd","Type":"ContainerStarted","Data":"52afcb4838b1765714c78384d89191b47e8380e98bebe0f764d09cd6f8bccf9b"} Nov 03 20:02:06.909691 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:06.909628 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" podStartSLOduration=2.307419029 podStartE2EDuration="2.909612844s" totalImagesPullingTime="602.193815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:06.908808434 +0000 UTC m=+668.808910240" watchObservedRunningTime="2026-11-03 20:02:06.909612844 +0000 UTC m=+668.809714650" Nov 03 20:02:07.073502 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:07.073426 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:07.915720 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:07.915689 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:02:07.927979 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:07.927951 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:02:08.805172 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:08.805143 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6" Nov 03 20:02:10.215724 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:10.215653 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:02:10.756215 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:02:10.756177 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:02:11.022349 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.022270 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d"] Nov 03 20:02:11.025612 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.025590 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.129946 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.129910 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Nov 03 20:02:11.131547 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.131523 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d"] Nov 03 20:02:11.133209 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133164 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.133209 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133209 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.133437 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133264 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.133437 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133359 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqxgz\" (UniqueName: \"kubernetes.io/projected/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-kube-api-access-sqxgz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.133437 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133397 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.133602 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.133466 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.234866 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.234833 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.234866 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.234869 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.234908 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqxgz\" (UniqueName: \"kubernetes.io/projected/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-kube-api-access-sqxgz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.234939 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.234978 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.235000 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.235379 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235602 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.235445 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.235602 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.235467 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.237388 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.237366 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.237679 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.237652 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.297839 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.297769 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqxgz\" (UniqueName: \"kubernetes.io/projected/8f1c5137-d475-4925-ba0c-d6fcadcd38c8-kube-api-access-sqxgz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rfs4d\" (UID: \"8f1c5137-d475-4925-ba0c-d6fcadcd38c8\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.340424 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.340389 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:11.734909 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.734761 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d"] Nov 03 20:02:11.737348 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:02:11.737322 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1c5137_d475_4925_ba0c_d6fcadcd38c8.slice/crio-3230b32d1d459e7ac4b738d6cb92281de7cc346ad4b76518a387c4a6cfe36497 WatchSource:0}: Error finding container 3230b32d1d459e7ac4b738d6cb92281de7cc346ad4b76518a387c4a6cfe36497: Status 404 returned error can't find the container with id 3230b32d1d459e7ac4b738d6cb92281de7cc346ad4b76518a387c4a6cfe36497 Nov 03 20:02:11.808296 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:11.808264 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" event={"ID":"8f1c5137-d475-4925-ba0c-d6fcadcd38c8","Type":"ContainerStarted","Data":"3230b32d1d459e7ac4b738d6cb92281de7cc346ad4b76518a387c4a6cfe36497"} Nov 03 20:02:12.813343 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:12.813311 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" event={"ID":"8f1c5137-d475-4925-ba0c-d6fcadcd38c8","Type":"ContainerStarted","Data":"c65c8abc78c8f4fafaf17460539f905298fc0d1892bf2e16b67ba13b435051f8"} Nov 03 20:02:12.983027 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:12.982973 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" podStartSLOduration=2.394496372 podStartE2EDuration="2.982957423s" totalImagesPullingTime="588.461051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:12.933590204 +0000 UTC m=+674.833692009" watchObservedRunningTime="2026-11-03 20:02:12.982957423 +0000 UTC m=+674.883059244" Nov 03 20:02:13.341643 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:13.341609 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:15.073942 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:15.073906 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:15.086255 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:15.086213 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:15.836842 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:15.836818 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-2v7cp" Nov 03 20:02:18.035359 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.035321 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6rx96"] Nov 03 20:02:18.038853 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.038828 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.094908 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.094879 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48512cab-0d50-4255-bbac-c5522a406daf-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.095063 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.094915 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.095063 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.094942 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.095063 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.095051 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.095203 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.095078 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-home\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.095203 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.095120 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdd5h\" (UniqueName: \"kubernetes.io/projected/48512cab-0d50-4255-bbac-c5522a406daf-kube-api-access-mdd5h\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.143148 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.143115 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\"" Nov 03 20:02:18.144809 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.144771 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6rx96"] Nov 03 20:02:18.196045 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196012 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196045 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196048 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-home\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196080 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd5h\" (UniqueName: \"kubernetes.io/projected/48512cab-0d50-4255-bbac-c5522a406daf-kube-api-access-mdd5h\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196129 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48512cab-0d50-4255-bbac-c5522a406daf-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196151 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196191 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196556 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196501 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196633 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196609 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-home\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.196688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.196615 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.198717 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.198697 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48512cab-0d50-4255-bbac-c5522a406daf-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.198987 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.198967 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48512cab-0d50-4255-bbac-c5522a406daf-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.258810 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.258776 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdd5h\" (UniqueName: \"kubernetes.io/projected/48512cab-0d50-4255-bbac-c5522a406daf-kube-api-access-mdd5h\") pod \"echo-simulator-kserve-64b6f8f96c-6rx96\" (UID: \"48512cab-0d50-4255-bbac-c5522a406daf\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.351921 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.351839 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:18.736525 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.736391 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6rx96"] Nov 03 20:02:18.840828 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:18.840791 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" event={"ID":"48512cab-0d50-4255-bbac-c5522a406daf","Type":"ContainerStarted","Data":"6160bafcf7beba4a6eb5b4bbb5a1ce9a5c75a476c6e3d50815ea38452b27d74a"} Nov 03 20:02:21.341779 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:21.341740 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:21.355761 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:21.355734 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:21.854998 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:21.854961 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" event={"ID":"48512cab-0d50-4255-bbac-c5522a406daf","Type":"ContainerStarted","Data":"e28746518b5a8ba53970fef1f6ed83dff868ca6b6c8d69fb5bd18a8e8d4f2b2d"} Nov 03 20:02:21.866200 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:21.866178 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rfs4d" Nov 03 20:02:21.975611 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:21.975556 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" podStartSLOduration=2.326941219 podStartE2EDuration="4.975541307s" totalImagesPullingTime="2.648600088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:21.974715932 +0000 UTC m=+683.874817739" watchObservedRunningTime="2026-11-03 20:02:21.975541307 +0000 UTC m=+683.875643114" Nov 03 20:02:22.352690 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:22.352657 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:25.171506 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.171474 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:02:25.449177 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.449098 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb"] Nov 03 20:02:25.452714 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.452696 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.506436 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.506412 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Nov 03 20:02:25.557664 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.557621 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.557833 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.557672 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.557833 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.557807 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.557919 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.557887 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.557991 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.557967 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m6z6\" (UniqueName: \"kubernetes.io/projected/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-kube-api-access-2m6z6\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.558049 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.558030 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.559001 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.558983 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb"] Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659416 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659494 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659558 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659588 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m6z6\" (UniqueName: \"kubernetes.io/projected/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-kube-api-access-2m6z6\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659638 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.660019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.659674 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.661456 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.661424 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.661767 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.661743 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.661925 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.661905 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.662622 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.662602 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.663218 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.663196 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.727090 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.727014 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m6z6\" (UniqueName: \"kubernetes.io/projected/fca3280b-47d9-42d5-aa28-441a7cc1dfd3-kube-api-access-2m6z6\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb\" (UID: \"fca3280b-47d9-42d5-aa28-441a7cc1dfd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:25.766370 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:25.766338 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:26.154203 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:26.154020 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb"] Nov 03 20:02:26.157101 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:02:26.157077 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfca3280b_47d9_42d5_aa28_441a7cc1dfd3.slice/crio-facb0a4c4524aa29cc264572befa21643786d23a41da730e6b0b1805d80bf8fd WatchSource:0}: Error finding container facb0a4c4524aa29cc264572befa21643786d23a41da730e6b0b1805d80bf8fd: Status 404 returned error can't find the container with id facb0a4c4524aa29cc264572befa21643786d23a41da730e6b0b1805d80bf8fd Nov 03 20:02:26.906188 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:26.906146 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" event={"ID":"fca3280b-47d9-42d5-aa28-441a7cc1dfd3","Type":"ContainerStarted","Data":"c7bf878401704819252f872f2147cbcb81a6d3b8aed53c5ef288b9af6c9a8340"} Nov 03 20:02:26.906602 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:26.906202 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" event={"ID":"fca3280b-47d9-42d5-aa28-441a7cc1dfd3","Type":"ContainerStarted","Data":"facb0a4c4524aa29cc264572befa21643786d23a41da730e6b0b1805d80bf8fd"} Nov 03 20:02:27.025523 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:27.025479 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" podStartSLOduration=1.388992367 podStartE2EDuration="2.025463945s" totalImagesPullingTime="636.471578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:27.025189553 +0000 UTC m=+688.925291360" watchObservedRunningTime="2026-11-03 20:02:27.025463945 +0000 UTC m=+688.925565755" Nov 03 20:02:27.767403 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:27.767370 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:28.352790 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:28.352759 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:28.365526 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:28.365505 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:28.924816 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:28.924781 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6rx96" Nov 03 20:02:35.282684 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:35.282648 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:02:35.766966 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:35.766932 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:35.779471 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:35.779446 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:35.980696 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:35.980666 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb" Nov 03 20:02:40.177127 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.177096 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd"] Nov 03 20:02:40.182879 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.182860 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.238699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.238673 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g4rk2\"" Nov 03 20:02:40.291590 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.291562 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd"] Nov 03 20:02:40.337550 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337518 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337583 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337663 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337784 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337700 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337784 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337730 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337847 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337789 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337847 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337830 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337913 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337895 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.337988 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.337975 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2c2m\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-kube-api-access-x2c2m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438723 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438652 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438723 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438681 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438723 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438702 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438763 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2c2m\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-kube-api-access-x2c2m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438811 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438855 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438883 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.438934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438915 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439171 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.438955 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439230 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.439192 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439329 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.439282 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439390 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.439363 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439446 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.439403 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.439518 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.439501 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.441339 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.441318 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.441551 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.441534 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.501737 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.501705 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.501859 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.501738 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2c2m\" (UniqueName: \"kubernetes.io/projected/5e8188c9-97cb-4dcf-b1a4-5c8733630eaa-kube-api-access-x2c2m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-6hkkd\" (UID: \"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:40.753872 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:02:40.753835 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:02:40.795491 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:40.795467 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:41.222005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:41.221985 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd"] Nov 03 20:02:41.223534 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:02:41.223504 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8188c9_97cb_4dcf_b1a4_5c8733630eaa.slice/crio-fe8b51a0501de132bbeaae985ea22e87b677d62963379abc33690d63da25de15 WatchSource:0}: Error finding container fe8b51a0501de132bbeaae985ea22e87b677d62963379abc33690d63da25de15: Status 404 returned error can't find the container with id fe8b51a0501de132bbeaae985ea22e87b677d62963379abc33690d63da25de15 Nov 03 20:02:42.005175 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:42.005123 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" event={"ID":"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa","Type":"ContainerStarted","Data":"fe8b51a0501de132bbeaae985ea22e87b677d62963379abc33690d63da25de15"} Nov 03 20:02:51.911828 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:51.911792 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:02:51.912287 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:51.911879 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:02:51.912287 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:51.911928 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:02:52.052329 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:52.052289 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" event={"ID":"5e8188c9-97cb-4dcf-b1a4-5c8733630eaa","Type":"ContainerStarted","Data":"a14ab735b702bf6640b6466a941ee60e9e2be21c6cdacac6ecfa8518cc6fa2a8"} Nov 03 20:02:52.201630 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:52.201522 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podStartSLOduration=1.5161432339999998 podStartE2EDuration="12.201507766s" totalImagesPullingTime="10.685364532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:52.199436349 +0000 UTC m=+714.099538155" watchObservedRunningTime="2026-11-03 20:02:52.201507766 +0000 UTC m=+714.101609572" Nov 03 20:02:52.796201 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:52.796166 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:52.797744 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:52.797719 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:52.797861 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:52.797810 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:53.795901 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:53.795863 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:53.796307 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:53.795930 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:54.796036 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:54.795994 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:54.796553 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:54.796055 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:55.688466 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.688426 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d8886d8d8-cfg9x"] Nov 03 20:02:55.691936 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.691910 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.758209 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.758185 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8886d8d8-cfg9x"] Nov 03 20:02:55.790543 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.790513 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6pv\" (UniqueName: \"kubernetes.io/projected/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-kube-api-access-wz6pv\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.790712 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.790634 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-oidc-ca\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.790712 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.790669 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-tls-cert\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.795623 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.795600 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:02:55.795830 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.795806 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:55.795896 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.795858 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:55.891909 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.891877 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-tls-cert\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.892392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.891941 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6pv\" (UniqueName: \"kubernetes.io/projected/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-kube-api-access-wz6pv\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.892392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.892052 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-oidc-ca\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.892657 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.892638 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-oidc-ca\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.894460 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.894443 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-tls-cert\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:55.954606 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:55.954523 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6pv\" (UniqueName: \"kubernetes.io/projected/92a383e7-1d13-4ad0-ae7a-c0cf3d12929a-kube-api-access-wz6pv\") pod \"authorino-d8886d8d8-cfg9x\" (UID: \"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a\") " pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:56.003509 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:56.003480 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8886d8d8-cfg9x" Nov 03 20:02:56.384130 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:56.375121 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8886d8d8-cfg9x"] Nov 03 20:02:56.388106 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:02:56.388074 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92a383e7_1d13_4ad0_ae7a_c0cf3d12929a.slice/crio-7545f954a49b53c4dc46316efb336ed7ec105615530bf49d2d5ed0964d59d923 WatchSource:0}: Error finding container 7545f954a49b53c4dc46316efb336ed7ec105615530bf49d2d5ed0964d59d923: Status 404 returned error can't find the container with id 7545f954a49b53c4dc46316efb336ed7ec105615530bf49d2d5ed0964d59d923 Nov 03 20:02:56.796573 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:56.796538 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:56.796750 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:56.796601 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:57.101580 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:57.101496 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8886d8d8-cfg9x" event={"ID":"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a","Type":"ContainerStarted","Data":"7545f954a49b53c4dc46316efb336ed7ec105615530bf49d2d5ed0964d59d923"} Nov 03 20:02:57.795798 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:57.795756 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:57.796000 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:57.795834 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:58.796138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:58.795910 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Nov 03 20:02:58.796138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:58.795995 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Nov 03 20:02:59.115078 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:59.114983 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8886d8d8-cfg9x" event={"ID":"92a383e7-1d13-4ad0-ae7a-c0cf3d12929a","Type":"ContainerStarted","Data":"37e6fb841f8e7466241c8b06ff43b6b994f36b541229784ab6b090f3f0e899ea"} Nov 03 20:02:59.285262 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:59.284552 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-d8886d8d8-cfg9x" podStartSLOduration=2.5891239219999997 podStartE2EDuration="4.284526158s" totalImagesPullingTime="1.695402236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:59.234437159 +0000 UTC m=+721.134538966" watchObservedRunningTime="2026-11-03 20:02:59.284526158 +0000 UTC m=+721.184627967" Nov 03 20:02:59.285944 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:02:59.285918 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:03:00.120064 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.120023 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" podUID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" containerName="authorino" containerID="cri-o://3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19" gracePeriod=30 Nov 03 20:03:00.404397 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.404366 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:03:00.437522 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.437484 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\") pod \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " Nov 03 20:03:00.437697 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.437589 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\" (UniqueName: \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\") pod \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " Nov 03 20:03:00.437764 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.437696 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\" (UniqueName: \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\") pod \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\" (UID: \"fdb08c1f-d1af-499a-a828-c6b1b81f96ad\") " Nov 03 20:03:00.440471 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.440428 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd" pod "fdb08c1f-d1af-499a-a828-c6b1b81f96ad" (UID: "fdb08c1f-d1af-499a-a828-c6b1b81f96ad"). InnerVolumeSpecName "kube-api-access-7m9fd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:03:00.443448 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.443410 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca" pod "fdb08c1f-d1af-499a-a828-c6b1b81f96ad" (UID: "fdb08c1f-d1af-499a-a828-c6b1b81f96ad"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:03:00.450534 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.450508 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert" pod "fdb08c1f-d1af-499a-a828-c6b1b81f96ad" (UID: "fdb08c1f-d1af-499a-a828-c6b1b81f96ad"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:03:00.545965 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.545916 4456 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-tls-cert\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:03:00.545965 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.545962 4456 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-oidc-ca\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:03:00.546221 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.545978 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m9fd\" (UniqueName: \"kubernetes.io/projected/fdb08c1f-d1af-499a-a828-c6b1b81f96ad-kube-api-access-7m9fd\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:03:00.658488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.658399 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:03:00.660391 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:00.660217 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" Nov 03 20:03:01.125952 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.125913 4456 generic.go:356] "Generic (PLEG): container finished" podID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" containerID="3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19" exitCode=0 Nov 03 20:03:01.126419 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.125960 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" event={"ID":"fdb08c1f-d1af-499a-a828-c6b1b81f96ad","Type":"ContainerDied","Data":"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19"} Nov 03 20:03:01.126419 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.125979 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" Nov 03 20:03:01.126419 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.126007 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d8bb9f59f-xv9s5" event={"ID":"fdb08c1f-d1af-499a-a828-c6b1b81f96ad","Type":"ContainerDied","Data":"de23a07cc4a1f0cc35a0abfb1857debfd9a28a74641efc798e84ae525a3b911f"} Nov 03 20:03:01.126419 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.126024 4456 scope.go:122] "RemoveContainer" containerID="3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19" Nov 03 20:03:01.137285 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.137266 4456 scope.go:122] "RemoveContainer" containerID="3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19" Nov 03 20:03:01.137595 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:03:01.137575 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19\": container with ID starting with 3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19 not found: ID does not exist" containerID="3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19" Nov 03 20:03:01.137675 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.137604 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19"} err="failed to get container status \"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19\": rpc error: code = NotFound desc = could not find container \"3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19\": container with ID starting with 3e56ca1d3f102d3df7ddcaca13298efa0ba60d80c92a1e9ddfccac6e4acc3d19 not found: ID does not exist" Nov 03 20:03:01.292580 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.292549 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:03:01.305781 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:01.305745 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d8bb9f59f-xv9s5"] Nov 03 20:03:02.215687 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:02.215654 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" path="/var/lib/kubelet/pods/fdb08c1f-d1af-499a-a828-c6b1b81f96ad/volumes" Nov 03 20:03:10.433125 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.433088 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj"] Nov 03 20:03:10.433659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.433464 4456 cpu_manager.go:414] "containerMap: removing container" podUID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" containerName="authorino" Nov 03 20:03:10.433659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.433474 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" containerName="authorino" Nov 03 20:03:10.433659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.433551 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="fdb08c1f-d1af-499a-a828-c6b1b81f96ad" containerName="authorino" Nov 03 20:03:10.438121 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.438101 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.544690 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.544656 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj"] Nov 03 20:03:10.546201 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546173 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546363 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546205 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546363 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546257 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546363 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546276 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vxh\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-kube-api-access-g8vxh\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546535 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546411 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546535 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546463 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546645 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546538 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546645 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546573 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.546645 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.546595 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f06204e2-ca07-4fd9-971b-f0e9524532cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647707 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647675 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647707 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647709 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647727 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f06204e2-ca07-4fd9-971b-f0e9524532cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647767 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647785 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647822 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647843 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vxh\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-kube-api-access-g8vxh\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.647902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647879 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648206 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.647915 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648206 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.648121 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648337 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.648281 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648337 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.648306 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648466 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.648448 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.648503 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.648488 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f06204e2-ca07-4fd9-971b-f0e9524532cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.650196 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.650176 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.650487 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.650471 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.710328 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.710265 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.710328 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.710321 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vxh\" (UniqueName: \"kubernetes.io/projected/f06204e2-ca07-4fd9-971b-f0e9524532cc-kube-api-access-g8vxh\") pod \"maas-default-gateway-openshift-default-59f957fdd7-lgvxj\" (UID: \"f06204e2-ca07-4fd9-971b-f0e9524532cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.750407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:10.750379 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:10.753162 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:03:10.753129 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:03:11.178658 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:11.178601 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj"] Nov 03 20:03:11.180764 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:03:11.180741 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06204e2_ca07_4fd9_971b_f0e9524532cc.slice/crio-89692f468472958767655fe72b9d451ee4ec606188f106f51c58fe7dcd2e45d0 WatchSource:0}: Error finding container 89692f468472958767655fe72b9d451ee4ec606188f106f51c58fe7dcd2e45d0: Status 404 returned error can't find the container with id 89692f468472958767655fe72b9d451ee4ec606188f106f51c58fe7dcd2e45d0 Nov 03 20:03:11.182811 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:11.182783 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:03:11.182883 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:11.182842 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:03:11.182918 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:11.182890 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:03:12.189863 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:12.189829 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" event={"ID":"f06204e2-ca07-4fd9-971b-f0e9524532cc","Type":"ContainerStarted","Data":"029c925c0aaa80fb15a88a36b3fab8b3d7e3264d370036a676f20426da895453"} Nov 03 20:03:12.190273 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:12.189879 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" event={"ID":"f06204e2-ca07-4fd9-971b-f0e9524532cc","Type":"ContainerStarted","Data":"89692f468472958767655fe72b9d451ee4ec606188f106f51c58fe7dcd2e45d0"} Nov 03 20:03:12.750847 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:12.750818 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:12.752139 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:12.752114 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:12.752270 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:12.752175 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:13.751188 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:13.751152 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:13.751599 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:13.751213 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:14.751367 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:14.751335 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:14.751735 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:14.751399 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:15.751135 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:15.751102 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:15.751328 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:15.751152 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:16.751624 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:16.751591 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:16.752023 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:16.751648 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:17.750977 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:17.750946 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Nov 03 20:03:17.751186 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:17.751005 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Nov 03 20:03:19.549293 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:19.549257 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:19.549755 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:19.549719 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:19.550821 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:19.550804 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" Nov 03 20:03:19.724191 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:19.724141 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podStartSLOduration=9.724128152 podStartE2EDuration="9.724128152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:03:12.367833073 +0000 UTC m=+734.267934879" watchObservedRunningTime="2026-11-03 20:03:19.724128152 +0000 UTC m=+741.624229957" Nov 03 20:03:32.237415 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.237384 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:03:32.244909 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.244880 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271062 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271004 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271358 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271329 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271549 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271373 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271549 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271501 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271549 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271530 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9p5\" (UniqueName: \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.271796 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.271568 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.351398 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.351368 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-b695bb2e-model-kserve-self-signed-certs\"" Nov 03 20:03:32.353399 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.353375 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:03:32.372189 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372158 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372189 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372189 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372229 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372263 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9p5\" (UniqueName: \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372281 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372317 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372665 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372645 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372728 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372668 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.372728 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.372713 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.374713 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.374692 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.374990 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.374973 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.435025 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.434990 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9p5\" (UniqueName: \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\") pod \"grid-inv-b695bb2e-model-kserve-6dc694749-t5m85\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.556623 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.556547 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:32.970561 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:32.970523 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:03:32.972588 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:03:32.972562 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04ce6d14_906f_42a6_8a5e_a59ed0dbb988.slice/crio-1df03bd4820006d82c7d7d16351058ed60f207f3b4cd93ba0bcdf084b830e7bb WatchSource:0}: Error finding container 1df03bd4820006d82c7d7d16351058ed60f207f3b4cd93ba0bcdf084b830e7bb: Status 404 returned error can't find the container with id 1df03bd4820006d82c7d7d16351058ed60f207f3b4cd93ba0bcdf084b830e7bb Nov 03 20:03:33.281023 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:33.280978 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" event={"ID":"04ce6d14-906f-42a6-8a5e-a59ed0dbb988","Type":"ContainerStarted","Data":"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3"} Nov 03 20:03:33.281023 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:33.281028 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" event={"ID":"04ce6d14-906f-42a6-8a5e-a59ed0dbb988","Type":"ContainerStarted","Data":"1df03bd4820006d82c7d7d16351058ed60f207f3b4cd93ba0bcdf084b830e7bb"} Nov 03 20:03:33.400601 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:33.400543 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" podStartSLOduration=1.4005233000000001 podStartE2EDuration="1.4005233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:03:33.399934707 +0000 UTC m=+755.300036514" watchObservedRunningTime="2026-11-03 20:03:33.4005233 +0000 UTC m=+755.300625107" Nov 03 20:03:33.556916 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:33.556837 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:36.890574 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:36.890539 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:03:40.753677 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:03:40.753594 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:03:42.557360 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:42.557326 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:42.570375 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:42.570349 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:03:43.342132 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:03:43.342102 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:04:00.511182 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:00.511140 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:04:10.755974 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:04:10.755937 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:04:10.946904 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:10.946874 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt"] Nov 03 20:04:10.951902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:10.951884 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041229 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041135 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041287 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2cb\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-kube-api-access-gx2cb\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041362 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041391 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041597 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041507 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041597 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041589 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edddc22b-fac6-455f-83e0-4b6feb4d839e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041714 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041649 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041714 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041684 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.041821 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.041755 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142397 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142365 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2cb\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-kube-api-access-gx2cb\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142397 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142401 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142417 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142432 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142454 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edddc22b-fac6-455f-83e0-4b6feb4d839e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142497 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142531 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142587 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.142650 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142612 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.143000 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142868 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.143000 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142910 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.143000 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.142981 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.143155 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.143016 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.143286 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.143269 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edddc22b-fac6-455f-83e0-4b6feb4d839e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.145021 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.144994 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.145290 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.145272 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.163392 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.163363 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt"] Nov 03 20:04:11.204812 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.204775 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.204940 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.204891 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2cb\" (UniqueName: \"kubernetes.io/projected/edddc22b-fac6-455f-83e0-4b6feb4d839e-kube-api-access-gx2cb\") pod \"maas-default-gateway-openshift-default-59f957fdd7-kndtt\" (UID: \"edddc22b-fac6-455f-83e0-4b6feb4d839e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.264713 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.264687 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:11.690376 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.690352 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt"] Nov 03 20:04:11.692192 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:04:11.692167 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedddc22b_fac6_455f_83e0_4b6feb4d839e.slice/crio-de80c44a8c29098be23a643437ab3b105a268cedeb6e9d0d59bd54889ee0422a WatchSource:0}: Error finding container de80c44a8c29098be23a643437ab3b105a268cedeb6e9d0d59bd54889ee0422a: Status 404 returned error can't find the container with id de80c44a8c29098be23a643437ab3b105a268cedeb6e9d0d59bd54889ee0422a Nov 03 20:04:11.694378 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.694347 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:04:11.694456 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.694414 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:04:11.694456 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:11.694442 4456 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 03 20:04:12.486656 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:12.486605 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" event={"ID":"edddc22b-fac6-455f-83e0-4b6feb4d839e","Type":"ContainerStarted","Data":"2559d7abbe2531005fe0211afa4f6398d60b845e9eab8e307d153f315e3b8752"} Nov 03 20:04:12.487101 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:12.486682 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" event={"ID":"edddc22b-fac6-455f-83e0-4b6feb4d839e","Type":"ContainerStarted","Data":"de80c44a8c29098be23a643437ab3b105a268cedeb6e9d0d59bd54889ee0422a"} Nov 03 20:04:13.281261 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:13.281117 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:13.281471 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:13.281317 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:13.281471 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:13.281365 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:14.272275 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:14.268325 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:14.272275 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:14.268383 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:15.271265 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:15.266631 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:15.271265 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:15.266696 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:16.270713 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:16.270672 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:16.271332 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:16.271301 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:17.274263 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:17.269677 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:17.274263 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:17.269754 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:18.265999 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:18.265961 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:18.266171 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:18.266041 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:19.265907 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:19.265874 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Nov 03 20:04:19.266315 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:19.265931 4456 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Nov 03 20:04:20.798683 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:20.798650 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:20.799171 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:20.799096 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:20.799940 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:20.799917 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" Nov 03 20:04:21.028719 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:21.028666 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podStartSLOduration=11.028646127 podStartE2EDuration="11.028646127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:04:12.678648606 +0000 UTC m=+794.578750413" watchObservedRunningTime="2026-11-03 20:04:21.028646127 +0000 UTC m=+802.928747952" Nov 03 20:04:40.754989 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:04:40.754949 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:04:41.268006 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:41.267972 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:04:50.594265 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:50.593332 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:04:50.594265 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:04:50.593401 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:05:10.754179 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:05:10.754099 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:05:22.664054 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:22.663969 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:05:25.942287 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:25.931925 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:05:37.508183 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:37.508146 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:05:40.754759 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:05:40.754723 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:05:41.009798 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.009694 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" podUID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" containerName="main" containerID="cri-o://1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3" gracePeriod=45 Nov 03 20:05:41.263318 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.263228 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:05:41.326325 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326289 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326520 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326339 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\" (UniqueName: \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326520 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326431 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326520 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326481 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326524 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\" (UniqueName: \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326568 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\") pod \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\" (UID: \"04ce6d14-906f-42a6-8a5e-a59ed0dbb988\") " Nov 03 20:05:41.326688 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326583 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:41.326836 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326776 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:41.326899 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.326885 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:41.327269 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.327027 4456 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tmp-dir\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:41.327269 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.327052 4456 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-model-cache\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:41.327269 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.327066 4456 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-home\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:41.328879 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.328847 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:41.328990 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.328895 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:05:41.328990 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.328921 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5" pod "04ce6d14-906f-42a6-8a5e-a59ed0dbb988" (UID: "04ce6d14-906f-42a6-8a5e-a59ed0dbb988"). InnerVolumeSpecName "kube-api-access-jz9p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:05:41.427813 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.427775 4456 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-dshm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:41.427813 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.427808 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9p5\" (UniqueName: \"kubernetes.io/projected/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-kube-api-access-jz9p5\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:41.427813 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:41.427818 4456 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04ce6d14-906f-42a6-8a5e-a59ed0dbb988-tls-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:42.038370 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.038325 4456 generic.go:356] "Generic (PLEG): container finished" podID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" containerID="1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3" exitCode=0 Nov 03 20:05:42.038370 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.038372 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" Nov 03 20:05:42.038866 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.038398 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" event={"ID":"04ce6d14-906f-42a6-8a5e-a59ed0dbb988","Type":"ContainerDied","Data":"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3"} Nov 03 20:05:42.038866 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.038448 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85" event={"ID":"04ce6d14-906f-42a6-8a5e-a59ed0dbb988","Type":"ContainerDied","Data":"1df03bd4820006d82c7d7d16351058ed60f207f3b4cd93ba0bcdf084b830e7bb"} Nov 03 20:05:42.038866 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.038465 4456 scope.go:122] "RemoveContainer" containerID="1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3" Nov 03 20:05:42.048447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.048428 4456 scope.go:122] "RemoveContainer" containerID="1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3" Nov 03 20:05:42.048758 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:05:42.048735 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3\": container with ID starting with 1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3 not found: ID does not exist" containerID="1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3" Nov 03 20:05:42.048810 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.048773 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3"} err="failed to get container status \"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3\": rpc error: code = NotFound desc = could not find container \"1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3\": container with ID starting with 1238b4fa34fb674edb779a74323dcd84743099e6910ec308f2d7d4b8d99580d3 not found: ID does not exist" Nov 03 20:05:42.206019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.205985 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:05:42.256942 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:42.256911 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-b695bb2e-model-kserve-6dc694749-t5m85"] Nov 03 20:05:44.215998 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:44.215968 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" path="/var/lib/kubelet/pods/04ce6d14-906f-42a6-8a5e-a59ed0dbb988/volumes" Nov 03 20:05:49.887066 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:49.887030 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:05:59.573163 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.573128 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:05:59.573605 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.573560 4456 cpu_manager.go:414] "containerMap: removing container" podUID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" containerName="main" Nov 03 20:05:59.573605 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.573571 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" containerName="main" Nov 03 20:05:59.573680 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.573625 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="04ce6d14-906f-42a6-8a5e-a59ed0dbb988" containerName="main" Nov 03 20:05:59.577775 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.577758 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637565 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637533 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637565 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637572 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637671 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hmd\" (UniqueName: \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637767 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637793 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.637827 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.637822 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.685954 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.685918 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-93130f4e-model-kserve-self-signed-certs\"" Nov 03 20:05:59.687692 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.687673 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:05:59.738467 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.738431 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.738725 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.738705 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.738895 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.738882 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.739008 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.738995 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.739151 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.739134 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hmd\" (UniqueName: \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.740795 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.740772 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.741295 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.740165 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.741446 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.741176 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.741549 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.739657 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.744303 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.744279 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.745434 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.745415 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.803081 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.803047 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hmd\" (UniqueName: \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\") pod \"grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:05:59.888993 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:05:59.888922 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:06:00.306903 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:00.306877 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:06:00.311721 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:06:00.311693 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ba17177_df88_4974_805b_d347e9809ef9.slice/crio-c2d5a5f8f231cada4d88554028ff5b66ea605653445ce7c0647d41a6bfe84581 WatchSource:0}: Error finding container c2d5a5f8f231cada4d88554028ff5b66ea605653445ce7c0647d41a6bfe84581: Status 404 returned error can't find the container with id c2d5a5f8f231cada4d88554028ff5b66ea605653445ce7c0647d41a6bfe84581 Nov 03 20:06:01.140384 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:01.140348 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" event={"ID":"2ba17177-df88-4974-805b-d347e9809ef9","Type":"ContainerStarted","Data":"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a"} Nov 03 20:06:01.140384 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:01.140390 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" event={"ID":"2ba17177-df88-4974-805b-d347e9809ef9","Type":"ContainerStarted","Data":"c2d5a5f8f231cada4d88554028ff5b66ea605653445ce7c0647d41a6bfe84581"} Nov 03 20:06:01.259495 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:01.259441 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" podStartSLOduration=2.259426581 podStartE2EDuration="2.259426581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:01.259103115 +0000 UTC m=+903.159204924" watchObservedRunningTime="2026-11-03 20:06:01.259426581 +0000 UTC m=+903.159528387" Nov 03 20:06:01.889929 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:01.889892 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:06:03.267200 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.267166 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:06:03.270702 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.270683 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.280631 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.280605 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmfl\" (UniqueName: \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.280722 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.280667 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.280848 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.280830 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.280906 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.280895 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.280940 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.280925 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.281026 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.281012 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.377863 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.377834 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-93130f4e-unmatched-kserve-self-signed-certs\"" Nov 03 20:06:03.379604 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.379582 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:06:03.382112 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382092 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmfl\" (UniqueName: \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382167 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382143 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382465 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382168 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382465 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382189 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382465 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382212 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382465 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382255 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382637 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382600 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382674 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382600 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.382714 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.382678 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.384629 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.384613 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.384741 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.384726 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.444369 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.444334 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmfl\" (UniqueName: \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\") pod \"grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.582548 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.582457 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:03.982913 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:03.982889 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:06:03.985496 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:06:03.985461 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b93d3d6_a6da_46c7_aa48_72647f95e25c.slice/crio-8adeb4b6633483dbdd8bf973377d17bc0a20996881d78f5231659f88fbc0949b WatchSource:0}: Error finding container 8adeb4b6633483dbdd8bf973377d17bc0a20996881d78f5231659f88fbc0949b: Status 404 returned error can't find the container with id 8adeb4b6633483dbdd8bf973377d17bc0a20996881d78f5231659f88fbc0949b Nov 03 20:06:04.155892 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:04.155858 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" event={"ID":"9b93d3d6-a6da-46c7-aa48-72647f95e25c","Type":"ContainerStarted","Data":"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8"} Nov 03 20:06:04.156103 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:04.155905 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" event={"ID":"9b93d3d6-a6da-46c7-aa48-72647f95e25c","Type":"ContainerStarted","Data":"8adeb4b6633483dbdd8bf973377d17bc0a20996881d78f5231659f88fbc0949b"} Nov 03 20:06:04.184823 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:04.184773 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:06:04.299077 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:04.299023 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" podStartSLOduration=1.299010252 podStartE2EDuration="1.299010252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:04.29844696 +0000 UTC m=+906.198548768" watchObservedRunningTime="2026-11-03 20:06:04.299010252 +0000 UTC m=+906.199112080" Nov 03 20:06:04.583450 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:04.583369 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:06.843442 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:06.843403 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:06:06.844043 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:06.844000 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:06:09.889298 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:09.889264 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:06:09.901774 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:09.901753 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:06:10.224077 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:10.224009 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:06:10.766086 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:06:10.766047 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:06:13.585637 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:13.585604 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:13.643131 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:13.643095 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:14.258250 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:14.258215 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:06:16.363662 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:16.363626 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:06:40.753411 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:06:40.753332 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:06:56.865098 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.865058 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:06:56.869312 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.869294 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:56.923199 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.923172 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 20:06:56.959972 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.959942 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:56.960117 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.960007 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6s8q\" (UniqueName: \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:56.960117 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.960094 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:56.960212 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.960194 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:56.974311 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.974224 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 20:06:56.974455 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.974224 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ztcrz\"" Nov 03 20:06:56.974455 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.974263 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-main-e56f6e-serving-cert\"" Nov 03 20:06:56.974455 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.974410 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 03 20:06:56.977615 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:56.977590 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:06:57.061659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.061627 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6s8q\" (UniqueName: \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.061659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.061665 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.061860 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.061712 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.061860 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.061759 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.061860 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:06:57.061842 4456 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-serving-cert: secret "maas-api-e2e-shared-a-main-e56f6e-serving-cert" not found Nov 03 20:06:57.061958 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:06:57.061910 4456 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls podName:133f4c45-5c62-4b41-87a4-fd6e9f39fda7 nodeName:}" failed. No retries permitted until 2026-11-03 20:06:57.561893442 +0000 UTC m=+959.461995241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls") pod "maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" (UID: "133f4c45-5c62-4b41-87a4-fd6e9f39fda7") : secret "maas-api-e2e-shared-a-main-e56f6e-serving-cert" not found Nov 03 20:06:57.062444 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.062418 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.064459 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.064435 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.126006 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.125929 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6s8q\" (UniqueName: \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.567173 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.567141 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.569820 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.569789 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") pod \"maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:57.782165 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:57.782130 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:58.161860 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:58.161830 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:06:58.163437 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:06:58.163403 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133f4c45_5c62_4b41_87a4_fd6e9f39fda7.slice/crio-e37fd82241877394746a93b7ed52cc797a7e08bc07100584cef43cddc1160663 WatchSource:0}: Error finding container e37fd82241877394746a93b7ed52cc797a7e08bc07100584cef43cddc1160663: Status 404 returned error can't find the container with id e37fd82241877394746a93b7ed52cc797a7e08bc07100584cef43cddc1160663 Nov 03 20:06:58.164804 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:58.164786 4456 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:06:58.448292 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:58.448184 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" event={"ID":"133f4c45-5c62-4b41-87a4-fd6e9f39fda7","Type":"ContainerStarted","Data":"e37fd82241877394746a93b7ed52cc797a7e08bc07100584cef43cddc1160663"} Nov 03 20:06:59.454393 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:59.454306 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" event={"ID":"133f4c45-5c62-4b41-87a4-fd6e9f39fda7","Type":"ContainerStarted","Data":"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374"} Nov 03 20:06:59.454783 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:59.454468 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:06:59.575888 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:06:59.575838 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" podStartSLOduration=2.643333344 podStartE2EDuration="3.575824023s" totalImagesPullingTime="932.490679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:59.575123947 +0000 UTC m=+961.475225752" watchObservedRunningTime="2026-11-03 20:06:59.575824023 +0000 UTC m=+961.475925830" Nov 03 20:07:05.481262 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:05.480454 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:07:05.527259 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:05.526465 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:07:10.754085 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:07:10.754049 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:07:24.407123 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.407092 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:07:24.410663 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.410634 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.517405 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.517374 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-main-12288c\"" Nov 03 20:07:24.517577 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.517418 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-main-12288c-dockercfg-c6472\"" Nov 03 20:07:24.519364 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.519343 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:07:24.557152 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.557117 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.557373 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.557181 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpr28\" (UniqueName: \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.658393 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.658312 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.658393 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.658387 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpr28\" (UniqueName: \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.659022 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.659002 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.720839 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.720812 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpr28\" (UniqueName: \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\") pod \"payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:24.722914 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:24.722892 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:25.094372 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:25.094346 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:07:25.095966 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:07:25.095941 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46286155_4c89_4b23_b8a7_32389f1e6bbd.slice/crio-04339003a28b149efdef05e3f98a4e5f06c88b64a8406c37ba218fef4dff4154 WatchSource:0}: Error finding container 04339003a28b149efdef05e3f98a4e5f06c88b64a8406c37ba218fef4dff4154: Status 404 returned error can't find the container with id 04339003a28b149efdef05e3f98a4e5f06c88b64a8406c37ba218fef4dff4154 Nov 03 20:07:25.598614 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:25.598580 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" event={"ID":"46286155-4c89-4b23-b8a7-32389f1e6bbd","Type":"ContainerStarted","Data":"124be5f7a0227a1140a40310ecd4d7ad3ba191bfb44665b10f4c5f2f6598d749"} Nov 03 20:07:25.599021 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:25.598629 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" event={"ID":"46286155-4c89-4b23-b8a7-32389f1e6bbd","Type":"ContainerStarted","Data":"04339003a28b149efdef05e3f98a4e5f06c88b64a8406c37ba218fef4dff4154"} Nov 03 20:07:25.599021 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:25.598683 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:25.718737 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:25.718686 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" podStartSLOduration=1.71867178 podStartE2EDuration="1.71867178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:07:25.716785639 +0000 UTC m=+987.616887457" watchObservedRunningTime="2026-11-03 20:07:25.71867178 +0000 UTC m=+987.618773586" Nov 03 20:07:32.049041 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.049007 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:07:32.052733 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.052717 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.160372 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.160340 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-main-12288c-serving-cert\"" Nov 03 20:07:32.162281 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.162260 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:07:32.232571 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.232538 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.232736 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.232603 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.232736 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.232693 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.232841 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.232744 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz45r\" (UniqueName: \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.334151 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.334064 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz45r\" (UniqueName: \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.334151 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.334115 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.334404 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.334173 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.334404 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.334203 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.334404 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:07:32.334333 4456 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-serving-cert: secret "maas-api-e2e-shared-b-main-12288c-serving-cert" not found Nov 03 20:07:32.334575 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:07:32.334413 4456 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls podName:ab409d1e-76b4-4b6e-b568-c4b3f6eade0d nodeName:}" failed. No retries permitted until 2026-11-03 20:07:32.834391024 +0000 UTC m=+994.734492810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls") pod "maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" (UID: "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d") : secret "maas-api-e2e-shared-b-main-12288c-serving-cert" not found Nov 03 20:07:32.334929 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.334904 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.336812 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.336790 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.397016 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.396981 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz45r\" (UniqueName: \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.841475 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.841440 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.843985 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.843956 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") pod \"maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:32.965164 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:32.965134 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:33.341548 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:33.341524 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:07:33.343497 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:07:33.343466 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab409d1e_76b4_4b6e_b568_c4b3f6eade0d.slice/crio-e161e7f5208aa7689ef6099ed95caf1092df948beb7d569528de8fe424e498fe WatchSource:0}: Error finding container e161e7f5208aa7689ef6099ed95caf1092df948beb7d569528de8fe424e498fe: Status 404 returned error can't find the container with id e161e7f5208aa7689ef6099ed95caf1092df948beb7d569528de8fe424e498fe Nov 03 20:07:33.639634 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:33.639549 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" event={"ID":"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d","Type":"ContainerStarted","Data":"e161e7f5208aa7689ef6099ed95caf1092df948beb7d569528de8fe424e498fe"} Nov 03 20:07:34.645797 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:34.645706 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" event={"ID":"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d","Type":"ContainerStarted","Data":"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5"} Nov 03 20:07:34.645797 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:34.645771 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:34.768641 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:34.768592 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" podStartSLOduration=1.853968643 podStartE2EDuration="2.768578902s" totalImagesPullingTime="914.610259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:07:34.767945567 +0000 UTC m=+996.668047385" watchObservedRunningTime="2026-11-03 20:07:34.768578902 +0000 UTC m=+996.668680707" Nov 03 20:07:36.606799 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:36.606772 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:07:40.657083 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:40.657054 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:07:40.756629 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:07:40.756594 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:07:40.816999 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:07:40.816966 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:08:04.269150 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:04.269111 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:08:10.754516 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:08:10.754431 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:08:40.364309 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:40.364261 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:08:40.845012 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:08:40.844967 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:08:56.469473 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.469440 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9041-0ce8b3"] Nov 03 20:08:56.472976 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.472962 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:08:56.498377 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.498348 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\") pod \"test-curl-9041-0ce8b3\" (UID: \"de692c32-4941-408b-996e-9385201ed4e2\") " pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:08:56.529019 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.528994 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-0ce8b3"] Nov 03 20:08:56.577078 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.577054 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gfpm9\"" Nov 03 20:08:56.599320 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.599293 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\") pod \"test-curl-9041-0ce8b3\" (UID: \"de692c32-4941-408b-996e-9385201ed4e2\") " pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:08:56.661473 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.661451 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\") pod \"test-curl-9041-0ce8b3\" (UID: \"de692c32-4941-408b-996e-9385201ed4e2\") " pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:08:56.784176 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:56.784149 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:08:57.155454 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:57.155430 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-0ce8b3"] Nov 03 20:08:57.158167 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:08:57.158141 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde692c32_4941_408b_996e_9385201ed4e2.slice/crio-83e388e888872ad8530eea69bf26f095205c827e2eb5e2a4ba8bf5dea4c776a2 WatchSource:0}: Error finding container 83e388e888872ad8530eea69bf26f095205c827e2eb5e2a4ba8bf5dea4c776a2: Status 404 returned error can't find the container with id 83e388e888872ad8530eea69bf26f095205c827e2eb5e2a4ba8bf5dea4c776a2 Nov 03 20:08:58.044560 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:58.044525 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-0ce8b3" event={"ID":"de692c32-4941-408b-996e-9385201ed4e2","Type":"ContainerStarted","Data":"83e388e888872ad8530eea69bf26f095205c827e2eb5e2a4ba8bf5dea4c776a2"} Nov 03 20:08:59.056629 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:59.056577 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-0ce8b3" event={"ID":"de692c32-4941-408b-996e-9385201ed4e2","Type":"ContainerStarted","Data":"5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1"} Nov 03 20:08:59.173139 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:08:59.173076 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9041-0ce8b3" podStartSLOduration=2.146132524 podStartE2EDuration="3.173059953s" totalImagesPullingTime="1.026927429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:08:59.171795001 +0000 UTC m=+1081.071896807" watchObservedRunningTime="2026-11-03 20:08:59.173059953 +0000 UTC m=+1081.073161760" Nov 03 20:09:00.695433 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:00.695400 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9041-0ce8b3"] Nov 03 20:09:00.701994 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:00.701968 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9041-0ce8b3"] Nov 03 20:09:01.066839 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:01.066795 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9041-0ce8b3" podUID="de692c32-4941-408b-996e-9385201ed4e2" containerName="test-curl-9041-0ce8b3" containerID="cri-o://5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1" gracePeriod=2 Nov 03 20:09:01.119122 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:09:01.119093 4456 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-0ce8b3\" is forbidden: User \"system:node:ip-10-0-134-71.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-71.us-west-1.compute.internal' and this object" podUID="de692c32-4941-408b-996e-9385201ed4e2" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:09:03.298704 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:03.298681 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:09:03.366278 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:03.366193 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\") pod \"de692c32-4941-408b-996e-9385201ed4e2\" (UID: \"de692c32-4941-408b-996e-9385201ed4e2\") " Nov 03 20:09:03.368294 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:03.368271 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596" pod "de692c32-4941-408b-996e-9385201ed4e2" (UID: "de692c32-4941-408b-996e-9385201ed4e2"). InnerVolumeSpecName "kube-api-access-q2596". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:03.466897 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:03.466865 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2596\" (UniqueName: \"kubernetes.io/projected/de692c32-4941-408b-996e-9385201ed4e2-kube-api-access-q2596\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:04.084138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.084098 4456 generic.go:356] "Generic (PLEG): container finished" podID="de692c32-4941-408b-996e-9385201ed4e2" containerID="5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1" exitCode=137 Nov 03 20:09:04.084138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.084148 4456 scope.go:122] "RemoveContainer" containerID="5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1" Nov 03 20:09:04.084490 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.084161 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:09:04.096809 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.096786 4456 scope.go:122] "RemoveContainer" containerID="5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1" Nov 03 20:09:04.097129 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:09:04.097110 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1\": container with ID starting with 5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1 not found: ID does not exist" containerID="5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1" Nov 03 20:09:04.097174 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.097139 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1"} err="failed to get container status \"5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1\": rpc error: code = NotFound desc = could not find container \"5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1\": container with ID starting with 5ca145d3088e8a67b0acbb99890fac6fbf0449b6cdb4cd854c8b1e878fec05e1 not found: ID does not exist" Nov 03 20:09:04.144752 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:09:04.144708 4456 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-0ce8b3\" is forbidden: User \"system:node:ip-10-0-134-71.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-71.us-west-1.compute.internal' and this object" podUID="de692c32-4941-408b-996e-9385201ed4e2" pod="opendatahub/test-curl-9041-0ce8b3" Nov 03 20:09:04.217810 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:04.217777 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de692c32-4941-408b-996e-9385201ed4e2" path="/var/lib/kubelet/pods/de692c32-4941-408b-996e-9385201ed4e2/volumes" Nov 03 20:09:10.753534 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:09:10.753497 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:09:20.094434 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:20.094399 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:09:31.709768 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:31.709349 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-6hkkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:09:31.709768 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:31.709437 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-6hkkd" podUID="5e8188c9-97cb-4dcf-b1a4-5c8733630eaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:09:34.794853 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:09:34.794811 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:09:40.778896 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:09:40.778817 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:10:06.842468 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:06.842412 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:06.843099 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:06.842506 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:10.754726 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:10:10.754685 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:10:14.100903 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:14.100866 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:10:15.231836 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:15.231650 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:10:21.958441 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:21.958405 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:10:26.666120 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:26.666087 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:10:30.274131 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.274093 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" podUID="2ba17177-df88-4974-805b-d347e9809ef9" containerName="main" containerID="cri-o://ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a" gracePeriod=45 Nov 03 20:10:30.553000 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.552969 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:10:30.651550 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651521 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.651758 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651586 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\" (UniqueName: \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.651758 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651657 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.651758 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651728 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.651938 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651776 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.651938 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.651798 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\") pod \"2ba17177-df88-4974-805b-d347e9809ef9\" (UID: \"2ba17177-df88-4974-805b-d347e9809ef9\") " Nov 03 20:10:30.652203 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.652169 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:30.652203 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.652187 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:30.652376 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.652354 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:30.654046 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.653892 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" Nov 03 20:10:30.654046 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.653932 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" event={"ID":"2ba17177-df88-4974-805b-d347e9809ef9","Type":"ContainerDied","Data":"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a"} Nov 03 20:10:30.654046 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.653993 4456 scope.go:122] "RemoveContainer" containerID="ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a" Nov 03 20:10:30.654273 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.654051 4456 generic.go:356] "Generic (PLEG): container finished" podID="2ba17177-df88-4974-805b-d347e9809ef9" containerID="ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a" exitCode=0 Nov 03 20:10:30.654273 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.654139 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8" event={"ID":"2ba17177-df88-4974-805b-d347e9809ef9","Type":"ContainerDied","Data":"c2d5a5f8f231cada4d88554028ff5b66ea605653445ce7c0647d41a6bfe84581"} Nov 03 20:10:30.654405 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.654356 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:30.654593 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.654528 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:30.654685 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.654667 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd" pod "2ba17177-df88-4974-805b-d347e9809ef9" (UID: "2ba17177-df88-4974-805b-d347e9809ef9"). InnerVolumeSpecName "kube-api-access-56hmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:10:30.674668 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.674641 4456 scope.go:122] "RemoveContainer" containerID="ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a" Nov 03 20:10:30.675021 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:10:30.674995 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a\": container with ID starting with ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a not found: ID does not exist" containerID="ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a" Nov 03 20:10:30.675105 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.675032 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a"} err="failed to get container status \"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a\": rpc error: code = NotFound desc = could not find container \"ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a\": container with ID starting with ccb06e5a3a548317e19f6c5de003f3af4b6b4c6deddb731518bfe0835ace935a not found: ID does not exist" Nov 03 20:10:30.753445 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753411 4456 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-model-cache\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:30.753445 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753437 4456 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-dshm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:30.753445 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753448 4456 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ba17177-df88-4974-805b-d347e9809ef9-tls-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:30.753683 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753457 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56hmd\" (UniqueName: \"kubernetes.io/projected/2ba17177-df88-4974-805b-d347e9809ef9-kube-api-access-56hmd\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:30.753683 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753466 4456 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-tmp-dir\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:30.753683 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:30.753475 4456 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ba17177-df88-4974-805b-d347e9809ef9-home\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:31.075780 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:31.075749 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:10:31.126530 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:31.126494 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-93130f4e-model-kserve-954f6d98c-gfvs8"] Nov 03 20:10:32.216907 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:32.216869 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ba17177-df88-4974-805b-d347e9809ef9" path="/var/lib/kubelet/pods/2ba17177-df88-4974-805b-d347e9809ef9/volumes" Nov 03 20:10:36.980256 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:36.980203 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" podUID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" containerName="main" containerID="cri-o://f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8" gracePeriod=45 Nov 03 20:10:37.249480 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.249450 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:10:37.323063 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323033 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\" (UniqueName: \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323214 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323111 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323208 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323284 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323317 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323315 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323483 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323373 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\") pod \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\" (UID: \"9b93d3d6-a6da-46c7-aa48-72647f95e25c\") " Nov 03 20:10:37.323536 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323497 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:37.323655 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323611 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:37.323721 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323679 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:37.323969 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323903 4456 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-home\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.323969 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323930 4456 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tmp-dir\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.323969 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.323945 4456 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-model-cache\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.325493 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.325469 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:10:37.325579 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.325537 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:37.325579 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.325561 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl" pod "9b93d3d6-a6da-46c7-aa48-72647f95e25c" (UID: "9b93d3d6-a6da-46c7-aa48-72647f95e25c"). InnerVolumeSpecName "kube-api-access-2pmfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:10:37.425547 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.425510 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pmfl\" (UniqueName: \"kubernetes.io/projected/9b93d3d6-a6da-46c7-aa48-72647f95e25c-kube-api-access-2pmfl\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.425547 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.425539 4456 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b93d3d6-a6da-46c7-aa48-72647f95e25c-dshm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.425547 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.425549 4456 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b93d3d6-a6da-46c7-aa48-72647f95e25c-tls-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:37.695853 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.695821 4456 generic.go:356] "Generic (PLEG): container finished" podID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" containerID="f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8" exitCode=0 Nov 03 20:10:37.696129 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.695862 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" Nov 03 20:10:37.696129 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.695897 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" event={"ID":"9b93d3d6-a6da-46c7-aa48-72647f95e25c","Type":"ContainerDied","Data":"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8"} Nov 03 20:10:37.696129 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.695937 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg" event={"ID":"9b93d3d6-a6da-46c7-aa48-72647f95e25c","Type":"ContainerDied","Data":"8adeb4b6633483dbdd8bf973377d17bc0a20996881d78f5231659f88fbc0949b"} Nov 03 20:10:37.696129 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.695954 4456 scope.go:122] "RemoveContainer" containerID="f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8" Nov 03 20:10:37.704999 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.704983 4456 scope.go:122] "RemoveContainer" containerID="f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8" Nov 03 20:10:37.705303 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:10:37.705267 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8\": container with ID starting with f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8 not found: ID does not exist" containerID="f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8" Nov 03 20:10:37.705348 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.705303 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8"} err="failed to get container status \"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8\": rpc error: code = NotFound desc = could not find container \"f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8\": container with ID starting with f9fd0758f4ac5c9e199643959dc801c0c2035ff96e3df086fcda6fb1277645d8 not found: ID does not exist" Nov 03 20:10:37.863028 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.862993 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:10:37.913921 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:37.913885 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-93130f4e-unmatched-kserve-85d4f456df-qqvrg"] Nov 03 20:10:38.216430 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:38.216399 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" path="/var/lib/kubelet/pods/9b93d3d6-a6da-46c7-aa48-72647f95e25c/volumes" Nov 03 20:10:40.755211 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:10:40.755181 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:10:42.909156 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909125 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:10:42.909584 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909569 4456 cpu_manager.go:414] "containerMap: removing container" podUID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" containerName="main" Nov 03 20:10:42.909584 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909581 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" containerName="main" Nov 03 20:10:42.909674 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909604 4456 cpu_manager.go:414] "containerMap: removing container" podUID="2ba17177-df88-4974-805b-d347e9809ef9" containerName="main" Nov 03 20:10:42.909674 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909609 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ba17177-df88-4974-805b-d347e9809ef9" containerName="main" Nov 03 20:10:42.909674 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909621 4456 cpu_manager.go:414] "containerMap: removing container" podUID="de692c32-4941-408b-996e-9385201ed4e2" containerName="test-curl-9041-0ce8b3" Nov 03 20:10:42.909674 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909626 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de692c32-4941-408b-996e-9385201ed4e2" containerName="test-curl-9041-0ce8b3" Nov 03 20:10:42.909816 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909708 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b93d3d6-a6da-46c7-aa48-72647f95e25c" containerName="main" Nov 03 20:10:42.909816 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909719 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ba17177-df88-4974-805b-d347e9809ef9" containerName="main" Nov 03 20:10:42.909816 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.909726 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="de692c32-4941-408b-996e-9385201ed4e2" containerName="test-curl-9041-0ce8b3" Nov 03 20:10:42.914025 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.914006 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981521 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981487 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981732 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981530 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981732 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981608 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981848 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981729 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981848 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981762 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:42.981848 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:42.981802 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hcx\" (UniqueName: \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.020630 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.020593 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-cf634b53-model-kserve-self-signed-certs\"" Nov 03 20:10:43.022510 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.022483 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:10:43.083049 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083012 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083049 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083062 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083327 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083178 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hcx\" (UniqueName: \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083327 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083226 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083327 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083269 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083327 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083325 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083545 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083493 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083676 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083651 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.083976 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.083766 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.086026 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.086006 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.086526 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.086511 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.146175 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.146144 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hcx\" (UniqueName: \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\") pod \"grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.226007 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.225928 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:43.653883 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.653854 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:10:43.654791 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:10:43.654768 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc95c638_d986_4da9_81cb_cbe4c3ecf557.slice/crio-9fad075b80a7c4c3cd5b2ac2d1cccdb110d7dadd9d84618f547151a7133070cc WatchSource:0}: Error finding container 9fad075b80a7c4c3cd5b2ac2d1cccdb110d7dadd9d84618f547151a7133070cc: Status 404 returned error can't find the container with id 9fad075b80a7c4c3cd5b2ac2d1cccdb110d7dadd9d84618f547151a7133070cc Nov 03 20:10:43.729829 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.729799 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" event={"ID":"cc95c638-d986-4da9-81cb-cbe4c3ecf557","Type":"ContainerStarted","Data":"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1"} Nov 03 20:10:43.729959 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.729842 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" event={"ID":"cc95c638-d986-4da9-81cb-cbe4c3ecf557","Type":"ContainerStarted","Data":"9fad075b80a7c4c3cd5b2ac2d1cccdb110d7dadd9d84618f547151a7133070cc"} Nov 03 20:10:43.860049 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:43.859989 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" podStartSLOduration=1.8599759150000001 podStartE2EDuration="1.859975915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:10:43.85791153 +0000 UTC m=+1185.758013335" watchObservedRunningTime="2026-11-03 20:10:43.859975915 +0000 UTC m=+1185.760077720" Nov 03 20:10:44.226850 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:44.226823 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:46.787119 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.787079 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:10:46.790768 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.790747 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.897606 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.897565 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-cf634b53-unmatched-kserve-self-signed-certs\"" Nov 03 20:10:46.898951 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.898931 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:10:46.924386 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924361 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.924479 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924411 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz64g\" (UniqueName: \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.924605 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924581 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.924659 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924631 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.924764 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924682 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:46.924764 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:46.924746 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025284 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025220 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz64g\" (UniqueName: \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025448 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025335 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025448 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025356 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025448 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025373 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025581 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025455 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025581 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025523 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025792 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025775 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025839 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025809 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.025872 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.025831 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.027812 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.027788 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.028033 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.028015 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.087581 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.087505 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz64g\" (UniqueName: \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\") pod \"grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.111407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.111378 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:47.516079 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.516050 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:10:47.517654 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:10:47.517630 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cd62718_f8bf_4db1_ba33_6dd6149a6d56.slice/crio-e92bda857556bdcce4a731e1f601ad0d556a5cedbf41a543538589de2b21a811 WatchSource:0}: Error finding container e92bda857556bdcce4a731e1f601ad0d556a5cedbf41a543538589de2b21a811: Status 404 returned error can't find the container with id e92bda857556bdcce4a731e1f601ad0d556a5cedbf41a543538589de2b21a811 Nov 03 20:10:47.752481 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.752438 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" event={"ID":"3cd62718-f8bf-4db1-ba33-6dd6149a6d56","Type":"ContainerStarted","Data":"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962"} Nov 03 20:10:47.752481 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.752484 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" event={"ID":"3cd62718-f8bf-4db1-ba33-6dd6149a6d56","Type":"ContainerStarted","Data":"e92bda857556bdcce4a731e1f601ad0d556a5cedbf41a543538589de2b21a811"} Nov 03 20:10:47.872801 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.872698 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" podStartSLOduration=1.872684553 podStartE2EDuration="1.872684553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:10:47.871661908 +0000 UTC m=+1189.771763791" watchObservedRunningTime="2026-11-03 20:10:47.872684553 +0000 UTC m=+1189.772786359" Nov 03 20:10:47.905474 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:47.905439 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:10:48.112081 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:48.112044 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:50.591458 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:50.591418 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-lgvxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:50.592097 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:50.592059 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-lgvxj" podUID="f06204e2-ca07-4fd9-971b-f0e9524532cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:53.226922 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:53.226886 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:53.240107 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:53.240082 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:53.820681 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:53.820652 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:10:57.112073 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:57.112040 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:57.124951 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:57.124926 4456 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:57.876375 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:57.876345 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:10:59.487805 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:10:59.487770 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:11:10.754085 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:11:10.753999 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:11:40.755020 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:11:40.754987 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:12:10.754648 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:12:10.754613 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:12:12.201278 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:12:12.201231 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:12:21.857380 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:12:21.857345 4456 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-kndtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:12:21.857807 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:12:21.857426 4456 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-kndtt" podUID="edddc22b-fac6-455f-83e0-4b6feb4d839e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:12:40.753356 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:12:40.753276 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:12:53.269915 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:12:53.269878 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:12:54.389097 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:12:54.389055 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:13:01.169955 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:01.169911 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:13:05.780447 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:05.780416 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:13:09.409997 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.409934 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" podUID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" containerName="main" containerID="cri-o://9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1" gracePeriod=45 Nov 03 20:13:09.669438 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.669384 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:13:09.720249 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.720196 4456 generic.go:356] "Generic (PLEG): container finished" podID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" containerID="9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1" exitCode=0 Nov 03 20:13:09.720418 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.720263 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" Nov 03 20:13:09.720418 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.720265 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" event={"ID":"cc95c638-d986-4da9-81cb-cbe4c3ecf557","Type":"ContainerDied","Data":"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1"} Nov 03 20:13:09.720418 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.720309 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk" event={"ID":"cc95c638-d986-4da9-81cb-cbe4c3ecf557","Type":"ContainerDied","Data":"9fad075b80a7c4c3cd5b2ac2d1cccdb110d7dadd9d84618f547151a7133070cc"} Nov 03 20:13:09.720418 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.720326 4456 scope.go:122] "RemoveContainer" containerID="9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1" Nov 03 20:13:09.728982 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.728960 4456 scope.go:122] "RemoveContainer" containerID="9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1" Nov 03 20:13:09.729254 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:13:09.729220 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1\": container with ID starting with 9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1 not found: ID does not exist" containerID="9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1" Nov 03 20:13:09.729300 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.729272 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1"} err="failed to get container status \"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1\": rpc error: code = NotFound desc = could not find container \"9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1\": container with ID starting with 9c3d3980c04f403f5b0b9dc46eca4d8b0e9cc22195f480b59ff5703282889eb1 not found: ID does not exist" Nov 03 20:13:09.761315 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761287 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761422 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761338 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761422 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761362 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761422 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761390 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761422 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761407 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761579 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761499 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\" (UniqueName: \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\") pod \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\" (UID: \"cc95c638-d986-4da9-81cb-cbe4c3ecf557\") " Nov 03 20:13:09.761579 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761544 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:09.761699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761639 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:09.761699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761654 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:09.761811 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761791 4456 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-home\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:09.761811 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761804 4456 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tmp-dir\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:09.761896 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.761817 4456 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-model-cache\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:09.763487 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.763467 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:09.763667 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.763645 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "kube-api-access-j9hcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:09.763764 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.763744 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs" pod "cc95c638-d986-4da9-81cb-cbe4c3ecf557" (UID: "cc95c638-d986-4da9-81cb-cbe4c3ecf557"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:13:09.863474 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.863441 4456 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc95c638-d986-4da9-81cb-cbe4c3ecf557-dshm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:09.863474 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.863472 4456 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc95c638-d986-4da9-81cb-cbe4c3ecf557-tls-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:09.863673 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:09.863487 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9hcx\" (UniqueName: \"kubernetes.io/projected/cc95c638-d986-4da9-81cb-cbe4c3ecf557-kube-api-access-j9hcx\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:10.145606 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:10.145576 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:13:10.148969 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:10.148945 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-cf634b53-model-kserve-58488b84d4-m4qvk"] Nov 03 20:13:10.215451 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:10.215424 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" path="/var/lib/kubelet/pods/cc95c638-d986-4da9-81cb-cbe4c3ecf557/volumes" Nov 03 20:13:10.752932 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:13:10.752897 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:13:16.190712 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.190655 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" podUID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" containerName="main" containerID="cri-o://2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962" gracePeriod=45 Nov 03 20:13:16.445964 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.445895 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:13:16.522738 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522706 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.522911 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522779 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.522911 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522871 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.522911 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522902 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.523088 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522953 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\" (UniqueName: \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.523088 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.522985 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\") pod \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\" (UID: \"3cd62718-f8bf-4db1-ba33-6dd6149a6d56\") " Nov 03 20:13:16.523199 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523116 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:16.523287 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523210 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:16.523351 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523322 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:16.523482 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523446 4456 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-home\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.523482 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523465 4456 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-model-cache\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.523482 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.523474 4456 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tmp-dir\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.524994 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.524969 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:13:16.524994 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.524976 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:16.525151 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.525133 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g" pod "3cd62718-f8bf-4db1-ba33-6dd6149a6d56" (UID: "3cd62718-f8bf-4db1-ba33-6dd6149a6d56"). InnerVolumeSpecName "kube-api-access-rz64g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:16.624790 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.624762 4456 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-dshm\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.624790 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.624790 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz64g\" (UniqueName: \"kubernetes.io/projected/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-kube-api-access-rz64g\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.624976 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.624801 4456 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cd62718-f8bf-4db1-ba33-6dd6149a6d56-tls-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:16.761871 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.761838 4456 generic.go:356] "Generic (PLEG): container finished" podID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" containerID="2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962" exitCode=0 Nov 03 20:13:16.762032 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.761884 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" Nov 03 20:13:16.762032 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.761923 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" event={"ID":"3cd62718-f8bf-4db1-ba33-6dd6149a6d56","Type":"ContainerDied","Data":"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962"} Nov 03 20:13:16.762032 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.761967 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z" event={"ID":"3cd62718-f8bf-4db1-ba33-6dd6149a6d56","Type":"ContainerDied","Data":"e92bda857556bdcce4a731e1f601ad0d556a5cedbf41a543538589de2b21a811"} Nov 03 20:13:16.762032 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.761986 4456 scope.go:122] "RemoveContainer" containerID="2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962" Nov 03 20:13:16.771170 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.771157 4456 scope.go:122] "RemoveContainer" containerID="2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962" Nov 03 20:13:16.771454 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:13:16.771435 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962\": container with ID starting with 2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962 not found: ID does not exist" containerID="2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962" Nov 03 20:13:16.771518 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.771460 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962"} err="failed to get container status \"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962\": rpc error: code = NotFound desc = could not find container \"2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962\": container with ID starting with 2ccb72d47c2b76820dd13f4768367ae2b12462553f5b28241cc5243a95aff962 not found: ID does not exist" Nov 03 20:13:16.932733 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.932697 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:13:16.935978 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:16.935957 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-cf634b53-unmatched-kserve-544d9f7f54-qdf5z"] Nov 03 20:13:18.216232 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:18.216187 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" path="/var/lib/kubelet/pods/3cd62718-f8bf-4db1-ba33-6dd6149a6d56/volumes" Nov 03 20:13:38.035356 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.035325 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:13:38.035979 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.035544 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" podUID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" containerName="maas-api" containerID="cri-o://755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374" gracePeriod=30 Nov 03 20:13:38.313978 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.313955 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:13:38.328892 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.328871 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") pod \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " Nov 03 20:13:38.329010 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.328918 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\") pod \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " Nov 03 20:13:38.329010 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.328981 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\" (UniqueName: \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\") pod \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " Nov 03 20:13:38.329010 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.329003 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\") pod \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\" (UID: \"133f4c45-5c62-4b41-87a4-fd6e9f39fda7\") " Nov 03 20:13:38.329341 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.329319 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca" pod "133f4c45-5c62-4b41-87a4-fd6e9f39fda7" (UID: "133f4c45-5c62-4b41-87a4-fd6e9f39fda7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:38.331132 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.331104 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs" pod "133f4c45-5c62-4b41-87a4-fd6e9f39fda7" (UID: "133f4c45-5c62-4b41-87a4-fd6e9f39fda7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:13:38.331213 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.331165 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q" pod "133f4c45-5c62-4b41-87a4-fd6e9f39fda7" (UID: "133f4c45-5c62-4b41-87a4-fd6e9f39fda7"). InnerVolumeSpecName "kube-api-access-s6s8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:38.331213 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.331174 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls" pod "133f4c45-5c62-4b41-87a4-fd6e9f39fda7" (UID: "133f4c45-5c62-4b41-87a4-fd6e9f39fda7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:13:38.430466 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.430424 4456 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-maas-api-tls\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:38.432290 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.432229 4456 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-openshift-service-ca\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:38.432498 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.432476 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6s8q\" (UniqueName: \"kubernetes.io/projected/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-kube-api-access-s6s8q\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:38.432619 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.432605 4456 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/133f4c45-5c62-4b41-87a4-fd6e9f39fda7-metrics-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:38.871248 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.871215 4456 generic.go:356] "Generic (PLEG): container finished" podID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" containerID="755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374" exitCode=0 Nov 03 20:13:38.871411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.871285 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" Nov 03 20:13:38.871411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.871302 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" event={"ID":"133f4c45-5c62-4b41-87a4-fd6e9f39fda7","Type":"ContainerDied","Data":"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374"} Nov 03 20:13:38.871411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.871377 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh" event={"ID":"133f4c45-5c62-4b41-87a4-fd6e9f39fda7","Type":"ContainerDied","Data":"e37fd82241877394746a93b7ed52cc797a7e08bc07100584cef43cddc1160663"} Nov 03 20:13:38.871411 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.871398 4456 scope.go:122] "RemoveContainer" containerID="755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374" Nov 03 20:13:38.881047 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.881033 4456 scope.go:122] "RemoveContainer" containerID="755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374" Nov 03 20:13:38.881307 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:13:38.881291 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374\": container with ID starting with 755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374 not found: ID does not exist" containerID="755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374" Nov 03 20:13:38.881355 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:38.881316 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374"} err="failed to get container status \"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374\": rpc error: code = NotFound desc = could not find container \"755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374\": container with ID starting with 755742a2ba88928f2598271510387ec9e9d253e2607ab35c0c55fbfd79de9374 not found: ID does not exist" Nov 03 20:13:39.061343 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:39.061303 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:13:39.062563 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:39.062529 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-main-e56f6e-67c999cbcc-ggckh"] Nov 03 20:13:40.215663 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:40.215612 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" path="/var/lib/kubelet/pods/133f4c45-5c62-4b41-87a4-fd6e9f39fda7/volumes" Nov 03 20:13:40.753736 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:13:40.753702 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:13:42.804920 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:42.804886 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:13:53.812084 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:53.812046 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:13:58.812975 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:58.812937 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" podUID="46286155-4c89-4b23-b8a7-32389f1e6bbd" containerName="payload-processing" containerID="cri-o://124be5f7a0227a1140a40310ecd4d7ad3ba191bfb44665b10f4c5f2f6598d749" gracePeriod=25 Nov 03 20:13:58.972329 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:58.972290 4456 generic.go:356] "Generic (PLEG): container finished" podID="46286155-4c89-4b23-b8a7-32389f1e6bbd" containerID="124be5f7a0227a1140a40310ecd4d7ad3ba191bfb44665b10f4c5f2f6598d749" exitCode=0 Nov 03 20:13:58.972475 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:58.972365 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" event={"ID":"46286155-4c89-4b23-b8a7-32389f1e6bbd","Type":"ContainerDied","Data":"124be5f7a0227a1140a40310ecd4d7ad3ba191bfb44665b10f4c5f2f6598d749"} Nov 03 20:13:59.070526 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.070470 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:13:59.234617 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.234584 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\") pod \"46286155-4c89-4b23-b8a7-32389f1e6bbd\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " Nov 03 20:13:59.234794 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.234635 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\" (UniqueName: \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\") pod \"46286155-4c89-4b23-b8a7-32389f1e6bbd\" (UID: \"46286155-4c89-4b23-b8a7-32389f1e6bbd\") " Nov 03 20:13:59.234934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.234912 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume" pod "46286155-4c89-4b23-b8a7-32389f1e6bbd" (UID: "46286155-4c89-4b23-b8a7-32389f1e6bbd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:59.236830 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.236807 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28" pod "46286155-4c89-4b23-b8a7-32389f1e6bbd" (UID: "46286155-4c89-4b23-b8a7-32389f1e6bbd"). InnerVolumeSpecName "kube-api-access-qpr28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:59.335963 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.335890 4456 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46286155-4c89-4b23-b8a7-32389f1e6bbd-plugins-config-volume\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:59.335963 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.335916 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpr28\" (UniqueName: \"kubernetes.io/projected/46286155-4c89-4b23-b8a7-32389f1e6bbd-kube-api-access-qpr28\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:59.978484 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.978457 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" Nov 03 20:13:59.979005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.978496 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w" event={"ID":"46286155-4c89-4b23-b8a7-32389f1e6bbd","Type":"ContainerDied","Data":"04339003a28b149efdef05e3f98a4e5f06c88b64a8406c37ba218fef4dff4154"} Nov 03 20:13:59.979005 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:13:59.978562 4456 scope.go:122] "RemoveContainer" containerID="124be5f7a0227a1140a40310ecd4d7ad3ba191bfb44665b10f4c5f2f6598d749" Nov 03 20:14:00.115720 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.115690 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:14:00.115899 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.115877 4456 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" podUID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" containerName="maas-api" containerID="cri-o://2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5" gracePeriod=30 Nov 03 20:14:00.146453 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.146430 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:14:00.166945 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.166917 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-12288c-55f4d7c574-8k45w"] Nov 03 20:14:00.224086 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.224046 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46286155-4c89-4b23-b8a7-32389f1e6bbd" path="/var/lib/kubelet/pods/46286155-4c89-4b23-b8a7-32389f1e6bbd/volumes" Nov 03 20:14:00.385108 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.385083 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:14:00.551452 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551369 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\" (UniqueName: \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\") pod \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " Nov 03 20:14:00.551452 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551451 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\") pod \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " Nov 03 20:14:00.551642 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551520 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") pod \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " Nov 03 20:14:00.551642 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551605 4456 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\") pod \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\" (UID: \"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d\") " Nov 03 20:14:00.551820 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551795 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca" pod "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" (UID: "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:14:00.551934 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.551911 4456 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-openshift-service-ca\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:00.553808 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.553777 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs" pod "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" (UID: "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:14:00.554139 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.554117 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r" pod "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" (UID: "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d"). InnerVolumeSpecName "kube-api-access-wz45r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:14:00.554213 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.554137 4456 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls" pod "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" (UID: "ab409d1e-76b4-4b6e-b568-c4b3f6eade0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:14:00.652624 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.652585 4456 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-maas-api-tls\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:00.652624 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.652613 4456 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-metrics-certs\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:00.652624 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.652625 4456 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz45r\" (UniqueName: \"kubernetes.io/projected/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d-kube-api-access-wz45r\") on node \"ip-10-0-134-71.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:00.984753 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.984722 4456 generic.go:356] "Generic (PLEG): container finished" podID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" containerID="2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5" exitCode=0 Nov 03 20:14:00.985227 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.984769 4456 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" Nov 03 20:14:00.985227 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.984807 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" event={"ID":"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d","Type":"ContainerDied","Data":"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5"} Nov 03 20:14:00.985227 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.984872 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g" event={"ID":"ab409d1e-76b4-4b6e-b568-c4b3f6eade0d","Type":"ContainerDied","Data":"e161e7f5208aa7689ef6099ed95caf1092df948beb7d569528de8fe424e498fe"} Nov 03 20:14:00.985227 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.984905 4456 scope.go:122] "RemoveContainer" containerID="2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5" Nov 03 20:14:00.995148 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.995130 4456 scope.go:122] "RemoveContainer" containerID="2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5" Nov 03 20:14:00.995518 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:14:00.995498 4456 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5\": container with ID starting with 2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5 not found: ID does not exist" containerID="2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5" Nov 03 20:14:00.995583 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:00.995528 4456 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5"} err="failed to get container status \"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5\": rpc error: code = NotFound desc = could not find container \"2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5\": container with ID starting with 2c0e7444cfb1d0424c5c11d4bb1b122704ff3dc31e875fc43f5091d6e02ae4f5 not found: ID does not exist" Nov 03 20:14:01.154313 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:01.154271 4456 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:14:01.204395 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:01.204362 4456 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-main-12288c-66b49c794c-xw98g"] Nov 03 20:14:02.216053 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:02.216021 4456 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" path="/var/lib/kubelet/pods/ab409d1e-76b4-4b6e-b568-c4b3f6eade0d/volumes" Nov 03 20:14:04.994550 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:04.994517 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-tr4wk"] Nov 03 20:14:07.851855 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:07.851825 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8886d8d8-cfg9x_92a383e7-1d13-4ad0-ae7a-c0cf3d12929a/authorino/0.log" Nov 03 20:14:10.754623 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:14:10.754534 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:14:19.955770 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:19.955724 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-598949b94-lwknj_a9533bfc-db3b-412d-b8b7-07faa97fed24/manager/0.log" Nov 03 20:14:21.539954 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:21.539921 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6976955-8fvl7_f0577860-f04f-4fee-b29b-4e1bc2fdcc48/manager/0.log" Nov 03 20:14:22.222089 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:22.222062 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f52jn_50422f88-51d3-42c9-ae7a-1b643ded72a1/manager/0.log" Nov 03 20:14:22.472323 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:22.472258 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-hcbgc_7892e5a1-87aa-42fa-89d3-90438409c516/proxy/0.log" Nov 03 20:14:28.027358 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:28.027329 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8886d8d8-cfg9x_92a383e7-1d13-4ad0-ae7a-c0cf3d12929a/authorino/0.log" Nov 03 20:14:29.674540 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:29.674488 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-tr4wk_6c26d246-c89e-413d-942d-a97267065c8f/limitador/0.log" Nov 03 20:14:31.193250 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:31.193220 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-86dq7_a8542627-be0b-4b94-beaa-8fc8f4f4fccc/discovery/0.log" Nov 03 20:14:31.423652 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:31.423620 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c576ffb-dbtgj_2bb67ba3-76b8-49a4-a4d1-199d1489585d/kube-auth-proxy/0.log" Nov 03 20:14:32.175550 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:32.175516 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-6hkkd_5e8188c9-97cb-4dcf-b1a4-5c8733630eaa/istio-proxy/0.log" Nov 03 20:14:32.630895 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:32.630858 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-kndtt_edddc22b-fac6-455f-83e0-4b6feb4d839e/istio-proxy/0.log" Nov 03 20:14:32.859195 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:32.859165 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-lgvxj_f06204e2-ca07-4fd9-971b-f0e9524532cc/istio-proxy/0.log" Nov 03 20:14:34.540425 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:34.540395 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wpsp2_71914d47-f09e-43fa-b5d7-925b5000ca33/payload-pre-processing/0.log" Nov 03 20:14:34.764885 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:34.764851 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-qcnxp_9271bf7d-b429-4068-abc6-2175b09b0484/payload-processing/0.log" Nov 03 20:14:36.285157 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:36.285128 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-nxbc6_fc2dcf52-884a-401c-8f18-28b36e6268fd/main/0.log" Nov 03 20:14:36.564294 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:36.564202 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-2v7cp_e09eca27-7fbc-41cd-81c9-98e937e7a9fd/main/0.log" Nov 03 20:14:37.043587 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:37.043559 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rfs4d_8f1c5137-d475-4925-ba0c-d6fcadcd38c8/main/0.log" Nov 03 20:14:37.495680 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:37.495651 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-6rx96_48512cab-0d50-4255-bbac-c5522a406daf/main/0.log" Nov 03 20:14:37.944987 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:37.944915 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-x58jb_fca3280b-47d9-42d5-aa28-441a7cc1dfd3/main/0.log" Nov 03 20:14:40.754442 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:14:40.754403 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:14:47.977153 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977120 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gtkw/must-gather-8wr9x"] Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977541 4456 cpu_manager.go:414] "containerMap: removing container" podUID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" containerName="main" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977554 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" containerName="main" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977570 4456 cpu_manager.go:414] "containerMap: removing container" podUID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" containerName="main" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977574 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" containerName="main" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977591 4456 cpu_manager.go:414] "containerMap: removing container" podUID="46286155-4c89-4b23-b8a7-32389f1e6bbd" containerName="payload-processing" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977601 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46286155-4c89-4b23-b8a7-32389f1e6bbd" containerName="payload-processing" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977615 4456 cpu_manager.go:414] "containerMap: removing container" podUID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" containerName="maas-api" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977621 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" containerName="maas-api" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977628 4456 cpu_manager.go:414] "containerMap: removing container" podUID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" containerName="maas-api" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977633 4456 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" containerName="maas-api" Nov 03 20:14:47.977699 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977706 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="46286155-4c89-4b23-b8a7-32389f1e6bbd" containerName="payload-processing" Nov 03 20:14:47.978030 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977716 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="133f4c45-5c62-4b41-87a4-fd6e9f39fda7" containerName="maas-api" Nov 03 20:14:47.978030 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977723 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab409d1e-76b4-4b6e-b568-c4b3f6eade0d" containerName="maas-api" Nov 03 20:14:47.978030 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977730 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cd62718-f8bf-4db1-ba33-6dd6149a6d56" containerName="main" Nov 03 20:14:47.978030 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.977736 4456 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc95c638-d986-4da9-81cb-cbe4c3ecf557" containerName="main" Nov 03 20:14:47.980855 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:47.980838 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.039713 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.039683 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/must-gather-8wr9x"] Nov 03 20:14:48.088989 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.088955 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gtkw\"/\"openshift-service-ca.crt\"" Nov 03 20:14:48.088989 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.088988 4456 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gtkw\"/\"default-dockercfg-w5sd2\"" Nov 03 20:14:48.089269 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.088993 4456 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gtkw\"/\"kube-root-ca.crt\"" Nov 03 20:14:48.093608 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.093585 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxxx\" (UniqueName: \"kubernetes.io/projected/b7bdd102-90e7-4785-b1f3-e65a259bee64-kube-api-access-jnxxx\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.093725 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.093701 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7bdd102-90e7-4785-b1f3-e65a259bee64-must-gather-output\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.194654 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.194620 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxxx\" (UniqueName: \"kubernetes.io/projected/b7bdd102-90e7-4785-b1f3-e65a259bee64-kube-api-access-jnxxx\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.194846 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.194677 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7bdd102-90e7-4785-b1f3-e65a259bee64-must-gather-output\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.194993 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.194976 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7bdd102-90e7-4785-b1f3-e65a259bee64-must-gather-output\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.273417 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.273381 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxxx\" (UniqueName: \"kubernetes.io/projected/b7bdd102-90e7-4785-b1f3-e65a259bee64-kube-api-access-jnxxx\") pod \"must-gather-8wr9x\" (UID: \"b7bdd102-90e7-4785-b1f3-e65a259bee64\") " pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.294942 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.294910 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" Nov 03 20:14:48.671751 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.671723 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/must-gather-8wr9x"] Nov 03 20:14:48.673883 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:14:48.673854 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7bdd102_90e7_4785_b1f3_e65a259bee64.slice/crio-cbc7e0297885f7f53cdb5f850012799c466e21bad90edf14186f5d15c01e8e66 WatchSource:0}: Error finding container cbc7e0297885f7f53cdb5f850012799c466e21bad90edf14186f5d15c01e8e66: Status 404 returned error can't find the container with id cbc7e0297885f7f53cdb5f850012799c466e21bad90edf14186f5d15c01e8e66 Nov 03 20:14:48.675826 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:48.675809 4456 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:14:49.199463 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:49.199425 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" event={"ID":"b7bdd102-90e7-4785-b1f3-e65a259bee64","Type":"ContainerStarted","Data":"cbc7e0297885f7f53cdb5f850012799c466e21bad90edf14186f5d15c01e8e66"} Nov 03 20:14:50.205728 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:50.205693 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" event={"ID":"b7bdd102-90e7-4785-b1f3-e65a259bee64","Type":"ContainerStarted","Data":"2605ada4f8b8354e6e251bf6ae666bee703eb59c3ff75d6084d7e1c02242fe7e"} Nov 03 20:14:50.206138 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:50.205738 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" event={"ID":"b7bdd102-90e7-4785-b1f3-e65a259bee64","Type":"ContainerStarted","Data":"21d6797bc8b05ec5cb3d53acd9a8d6ad6b028faf77798293b9c4f131d67b674b"} Nov 03 20:14:50.324001 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:50.323945 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-4gtkw/must-gather-8wr9x" podStartSLOduration=2.099392668 podStartE2EDuration="3.323931746s" totalImagesPullingTime="1.224539078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:14:50.32264302 +0000 UTC m=+1432.222744830" watchObservedRunningTime="2026-11-03 20:14:50.323931746 +0000 UTC m=+1432.224033551" Nov 03 20:14:58.273259 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:58.271587 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tcj5c_c2ea6d24-ca0a-456a-9e54-b6d34061a066/global-pull-secret-syncer/0.log" Nov 03 20:14:59.221186 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:14:59.221142 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-598949b94-lwknj_a9533bfc-db3b-412d-b8b7-07faa97fed24/manager/0.log" Nov 03 20:15:00.435152 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:00.435116 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6976955-8fvl7_f0577860-f04f-4fee-b29b-4e1bc2fdcc48/manager/0.log" Nov 03 20:15:00.631619 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:00.631567 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-98mpb_7d2c4acc-8137-41ae-b516-4295e9ba1556/konnectivity-agent/0.log" Nov 03 20:15:00.822199 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:00.822170 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f52jn_50422f88-51d3-42c9-ae7a-1b643ded72a1/manager/0.log" Nov 03 20:15:00.982157 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:00.982127 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-hcbgc_7892e5a1-87aa-42fa-89d3-90438409c516/proxy/0.log" Nov 03 20:15:02.346085 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:02.346056 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-71.us-west-1.compute.internal_0b3dd5bb7ddeae35bdfefc31e3d9883e/haproxy/0.log" Nov 03 20:15:03.891299 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:03.891268 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-598949b94-lwknj_a9533bfc-db3b-412d-b8b7-07faa97fed24/manager/0.log" Nov 03 20:15:05.030212 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:05.030180 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6976955-8fvl7_f0577860-f04f-4fee-b29b-4e1bc2fdcc48/manager/0.log" Nov 03 20:15:05.471989 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:05.471841 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f52jn_50422f88-51d3-42c9-ae7a-1b643ded72a1/manager/0.log" Nov 03 20:15:05.625224 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:05.625184 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-hcbgc_7892e5a1-87aa-42fa-89d3-90438409c516/proxy/0.log" Nov 03 20:15:06.216646 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:06.216620 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8886d8d8-cfg9x_92a383e7-1d13-4ad0-ae7a-c0cf3d12929a/authorino/0.log" Nov 03 20:15:07.394818 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.394775 4456 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk"] Nov 03 20:15:07.400225 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.400203 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.465321 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.465289 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-podres\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.465507 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.465348 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs45s\" (UniqueName: \"kubernetes.io/projected/741bfa13-8a47-408f-9f42-d61eb2008d93-kube-api-access-xs45s\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.465507 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.465482 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-sys\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.465604 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.465561 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-lib-modules\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.465661 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.465646 4456 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-proc\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.487047 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.487012 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk"] Nov 03 20:15:07.566305 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566270 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-sys\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566338 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-lib-modules\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566388 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-proc\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566388 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-sys\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566461 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-proc\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566464 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-lib-modules\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566488 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566474 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-podres\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566711 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566510 4456 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs45s\" (UniqueName: \"kubernetes.io/projected/741bfa13-8a47-408f-9f42-d61eb2008d93-kube-api-access-xs45s\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.566711 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.566534 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/741bfa13-8a47-408f-9f42-d61eb2008d93-podres\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.628902 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.628868 4456 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs45s\" (UniqueName: \"kubernetes.io/projected/741bfa13-8a47-408f-9f42-d61eb2008d93-kube-api-access-xs45s\") pod \"perf-node-gather-daemonset-v4nxk\" (UID: \"741bfa13-8a47-408f-9f42-d61eb2008d93\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:07.713132 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:07.713049 4456 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:08.083307 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.083281 4456 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk"] Nov 03 20:15:08.085382 ip-10-0-134-71 kubenswrapper[4456]: W1103 20:15:08.085357 4456 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod741bfa13_8a47_408f_9f42_d61eb2008d93.slice/crio-a13c78a6c7b9b54b473bdbae6e2338dcc2ca1e48aaea751ced2fbc154eb57d26 WatchSource:0}: Error finding container a13c78a6c7b9b54b473bdbae6e2338dcc2ca1e48aaea751ced2fbc154eb57d26: Status 404 returned error can't find the container with id a13c78a6c7b9b54b473bdbae6e2338dcc2ca1e48aaea751ced2fbc154eb57d26 Nov 03 20:15:08.329841 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.329798 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" event={"ID":"741bfa13-8a47-408f-9f42-d61eb2008d93","Type":"ContainerStarted","Data":"9370f7192238a529e09402460a10bdc9e80ec20059a62d0c6552c10e04d973f5"} Nov 03 20:15:08.330031 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.329870 4456 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" event={"ID":"741bfa13-8a47-408f-9f42-d61eb2008d93","Type":"ContainerStarted","Data":"a13c78a6c7b9b54b473bdbae6e2338dcc2ca1e48aaea751ced2fbc154eb57d26"} Nov 03 20:15:08.330282 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.330259 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:08.400647 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.400574 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-tr4wk_6c26d246-c89e-413d-942d-a97267065c8f/limitador/0.log" Nov 03 20:15:08.448808 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.448755 4456 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" podStartSLOduration=1.4487412370000001 podStartE2EDuration="1.448741237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:15:08.448174713 +0000 UTC m=+1450.348276520" watchObservedRunningTime="2026-11-03 20:15:08.448741237 +0000 UTC m=+1450.348843044" Nov 03 20:15:08.496905 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:08.496873 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-598949b94-lwknj_a9533bfc-db3b-412d-b8b7-07faa97fed24/manager/0.log" Nov 03 20:15:09.493454 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:09.493423 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f6976955-8fvl7_f0577860-f04f-4fee-b29b-4e1bc2fdcc48/manager/0.log" Nov 03 20:15:09.928764 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:09.928687 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-f52jn_50422f88-51d3-42c9-ae7a-1b643ded72a1/manager/0.log" Nov 03 20:15:10.081018 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:10.080996 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-hcbgc_7892e5a1-87aa-42fa-89d3-90438409c516/proxy/0.log" Nov 03 20:15:10.753600 ip-10-0-134-71 kubenswrapper[4456]: E1103 20:15:10.753565 4456 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-85rll" containerName="extractor" Nov 03 20:15:13.783289 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:13.783257 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-86dq7_a8542627-be0b-4b94-beaa-8fc8f4f4fccc/discovery/0.log" Nov 03 20:15:13.972064 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:13.972038 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-655c576ffb-dbtgj_2bb67ba3-76b8-49a4-a4d1-199d1489585d/kube-auth-proxy/0.log" Nov 03 20:15:14.345038 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:14.345012 4456 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-v4nxk" Nov 03 20:15:14.614407 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:14.614328 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-6hkkd_5e8188c9-97cb-4dcf-b1a4-5c8733630eaa/istio-proxy/0.log" Nov 03 20:15:15.045429 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:15.045399 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-kndtt_edddc22b-fac6-455f-83e0-4b6feb4d839e/istio-proxy/0.log" Nov 03 20:15:15.264396 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:15.264369 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-lgvxj_f06204e2-ca07-4fd9-971b-f0e9524532cc/istio-proxy/0.log" Nov 03 20:15:16.556668 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:16.556634 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-vdm9p_bbd1a511-106c-4178-8103-af1c50a783f5/monitoring-plugin/0.log" Nov 03 20:15:16.714338 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:16.714309 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-wpsp2_71914d47-f09e-43fa-b5d7-925b5000ca33/payload-pre-processing/0.log" Nov 03 20:15:16.930433 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:16.930355 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-qcnxp_9271bf7d-b429-4068-abc6-2175b09b0484/payload-processing/0.log" Nov 03 20:15:16.984888 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:16.984862 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhz9z_a211ad0c-1cad-4320-8d49-1b545abfea57/node-exporter/0.log" Nov 03 20:15:17.407841 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:17.407815 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhz9z_a211ad0c-1cad-4320-8d49-1b545abfea57/kube-rbac-proxy/0.log" Nov 03 20:15:17.830633 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:17.830599 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhz9z_a211ad0c-1cad-4320-8d49-1b545abfea57/init-textfile/0.log" Nov 03 20:15:20.457012 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:20.456978 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d8886d8d8-cfg9x_92a383e7-1d13-4ad0-ae7a-c0cf3d12929a/authorino/0.log" Nov 03 20:15:21.547845 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:21.547816 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-tr4wk_6c26d246-c89e-413d-942d-a97267065c8f/limitador/0.log" Nov 03 20:15:25.991949 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:25.991907 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-xk2g6_0673a2f4-7421-4aa7-801f-02963a157091/prometheus-operator-admission-webhook/0.log" Nov 03 20:15:26.415667 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:26.415586 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d94fd96b-4kp74_fc601e41-54fc-4e11-b325-42ccb2cfd389/telemeter-client/0.log" Nov 03 20:15:26.835391 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:26.835363 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d94fd96b-4kp74_fc601e41-54fc-4e11-b325-42ccb2cfd389/reload/0.log" Nov 03 20:15:27.262515 ip-10-0-134-71 kubenswrapper[4456]: I1103 20:15:27.262483 4456 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56d94fd96b-4kp74_fc601e41-54fc-4e11-b325-42ccb2cfd389/kube-rbac-proxy/0.log"