Oct 30 14:06:16.440869 ip-10-0-130-107 systemd[1]: Starting Kubernetes Kubelet... Oct 30 14:06:16.837740 ip-10-0-130-107 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:06:16.837740 ip-10-0-130-107 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 14:06:16.837740 ip-10-0-130-107 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:06:16.837740 ip-10-0-130-107 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:06:16.841536 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841453 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.841536 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841536 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.841536 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841540 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841557 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841560 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841563 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841567 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841569 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841572 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841575 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841580 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841585 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841589 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841591 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841595 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841598 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841601 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841605 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841608 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841611 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841614 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.841641 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841617 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841620 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841622 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841625 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841627 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841630 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841633 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841642 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841645 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841648 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841651 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841654 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841657 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841659 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841661 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841664 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841666 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841669 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841671 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841674 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.842075 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841676 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841679 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841681 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841684 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841686 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841689 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841691 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841694 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841697 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841700 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841702 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841705 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841708 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841712 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841715 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841717 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841720 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841723 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841725 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841728 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.842581 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841730 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841732 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841735 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841737 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841740 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841742 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841745 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841747 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841750 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841752 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841755 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841758 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841761 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841763 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841766 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841768 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841770 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841773 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841775 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841778 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.843053 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841781 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841783 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841786 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841788 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841791 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841795 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841798 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841800 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841803 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841806 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841808 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841810 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841813 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841815 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841818 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841820 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841823 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841826 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841828 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.843540 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841831 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841833 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841836 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841840 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841843 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.841847 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842628 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842636 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842639 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842642 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842644 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842648 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842651 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842654 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842657 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842659 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842662 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842664 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842667 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842670 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.844033 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842673 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842675 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842678 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842681 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842683 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842685 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842688 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842691 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842693 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842696 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842698 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842701 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842703 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842706 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842708 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842710 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842713 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842716 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842718 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842721 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.844661 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842724 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842726 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842729 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842731 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842734 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842737 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842740 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842742 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842745 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842748 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842751 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842754 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842756 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842759 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842762 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842764 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842768 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842770 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842773 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842776 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.845129 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842778 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842781 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842783 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842787 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842789 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842792 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842794 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842798 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842803 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842806 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842809 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842811 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842814 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842816 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842819 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842822 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842825 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842827 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842830 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842838 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.845657 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842841 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842844 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842847 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842850 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842852 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842855 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842857 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842860 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842863 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842865 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842868 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842870 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842873 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842875 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842878 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842880 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842883 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842885 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842888 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.846132 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842890 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842893 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842895 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842897 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842900 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842902 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842905 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842909 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842913 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842917 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842919 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842922 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.842925 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843406 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843411 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843414 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843417 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843420 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843422 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.846576 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843425 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843428 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843430 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843433 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843435 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843438 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843440 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843443 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843446 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843448 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843451 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843453 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843457 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843461 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843464 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843467 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843470 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843472 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843475 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843477 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.847023 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843480 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843482 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843485 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843488 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843490 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843493 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843496 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843499 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843502 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843504 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843508 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843512 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843515 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843518 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843520 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843524 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843526 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843529 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843531 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.847493 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843534 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843536 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843539 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843541 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843561 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843565 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843567 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843570 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843572 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843575 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843578 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843581 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843583 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843586 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843588 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843591 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843595 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843597 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843600 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.847970 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843602 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843606 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843608 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843611 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843613 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843616 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843619 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843621 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843624 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843626 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843629 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843631 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843634 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843636 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843638 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843641 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843644 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843647 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843649 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843652 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.848418 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843654 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843657 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843659 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843662 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843664 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843667 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843669 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843672 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843674 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843677 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843679 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843682 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843684 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843687 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843690 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843692 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843695 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843697 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843700 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.848974 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843703 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843705 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.843708 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844778 2576 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844790 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844796 2576 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844801 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844806 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844809 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844813 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844817 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844820 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844823 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844826 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844830 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844833 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844838 2576 flags.go:64] FLAG: --cgroup-root="" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844841 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844844 2576 flags.go:64] FLAG: --client-ca-file="" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844847 2576 flags.go:64] FLAG: --cloud-provider="external" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844851 2576 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844856 2576 flags.go:64] FLAG: --cluster-domain="" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844859 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 14:06:16.849426 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844862 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844865 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844869 2576 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844872 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844875 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844879 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844882 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844885 2576 flags.go:64] FLAG: --contention-profiling="false" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844888 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844891 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844894 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844897 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844901 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844904 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844907 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844909 2576 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844912 2576 flags.go:64] FLAG: --enable-server="true" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844915 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844919 2576 flags.go:64] FLAG: --event-burst="100" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844923 2576 flags.go:64] FLAG: --event-qps="50" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844925 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844928 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844931 2576 flags.go:64] FLAG: --eviction-hard="" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844935 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 14:06:16.849993 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844938 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844943 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844946 2576 flags.go:64] FLAG: --eviction-soft="" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844949 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844951 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844956 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844959 2576 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844962 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844965 2576 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844967 2576 flags.go:64] FLAG: --feature-gates="" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844971 2576 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844975 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844978 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844981 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844984 2576 flags.go:64] FLAG: --healthz-port="10248" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844987 2576 flags.go:64] FLAG: --help="false" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844990 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-107.ec2.internal" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844993 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844996 2576 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.844999 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845002 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845005 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845008 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 14:06:16.850614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845011 2576 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845013 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845016 2576 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845019 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845022 2576 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845025 2576 flags.go:64] FLAG: --kube-reserved="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845028 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845030 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845033 2576 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845036 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845041 2576 flags.go:64] FLAG: --lock-file="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845043 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845046 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845050 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845057 2576 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845060 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845063 2576 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845066 2576 flags.go:64] FLAG: --logging-format="text" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845069 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845072 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845075 2576 flags.go:64] FLAG: --manifest-url="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845077 2576 flags.go:64] FLAG: --manifest-url-header="" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845082 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845085 2576 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845090 2576 flags.go:64] FLAG: --max-pods="110" Oct 30 14:06:16.851172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845093 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845095 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845098 2576 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845101 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845104 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845106 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845109 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845117 2576 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845120 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845123 2576 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845126 2576 flags.go:64] FLAG: --pod-cidr="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845128 2576 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845131 2576 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845134 2576 flags.go:64] FLAG: --pods-per-core="0" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845137 2576 flags.go:64] FLAG: --port="10250" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845141 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845144 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b439ad08fadfbc5d" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845148 2576 flags.go:64] FLAG: --qos-reserved="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845162 2576 flags.go:64] FLAG: --read-only-port="10255" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845165 2576 flags.go:64] FLAG: --register-node="true" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845168 2576 flags.go:64] FLAG: --register-with-taints="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845172 2576 flags.go:64] FLAG: --registry-burst="10" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845175 2576 flags.go:64] FLAG: --registry-qps="5" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845178 2576 flags.go:64] FLAG: --reserved-cpus="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845181 2576 flags.go:64] FLAG: --reserved-memory="" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845184 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 14:06:16.851786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845187 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845190 2576 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845193 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845196 2576 flags.go:64] FLAG: --runonce="false" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845199 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845202 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845205 2576 flags.go:64] FLAG: --seccomp-default="false" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845208 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845211 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845214 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845217 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845220 2576 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845222 2576 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845225 2576 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845228 2576 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845231 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845234 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845237 2576 flags.go:64] FLAG: --system-cgroups="" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845239 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845244 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845247 2576 flags.go:64] FLAG: --tls-cert-file="" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845250 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845254 2576 flags.go:64] FLAG: --tls-min-version="" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845259 2576 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845262 2576 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 14:06:16.852386 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845265 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845268 2576 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845271 2576 flags.go:64] FLAG: --v="2" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845275 2576 flags.go:64] FLAG: --version="false" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845283 2576 flags.go:64] FLAG: --vmodule="" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845287 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845290 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845419 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845423 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845427 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845430 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845434 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845439 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845442 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845445 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845448 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845451 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845454 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845457 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845459 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845461 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.852985 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845464 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845466 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845469 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845471 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845473 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845476 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845478 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845481 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845484 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845487 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845490 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845492 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845495 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845498 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845500 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845503 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845505 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845508 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845510 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845513 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.853498 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845515 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845518 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845520 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845523 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845525 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845528 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845530 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845533 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845535 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845537 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845540 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845542 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845558 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845560 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845563 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845565 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845568 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845570 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845573 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.854020 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845575 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845578 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845582 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845584 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845587 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845590 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845592 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845595 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845597 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845600 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845602 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845605 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845607 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845610 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845612 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845615 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845617 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845620 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845622 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845624 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.854455 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845627 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845630 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845632 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845635 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845637 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845640 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845642 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845644 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845647 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845649 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845653 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845655 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845658 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845661 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845665 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845668 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845670 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845673 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845676 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845678 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.854936 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845681 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845683 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845686 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845688 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845691 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845694 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845696 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845699 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845701 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845705 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845709 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845712 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845716 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.845741 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845776 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.855403 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845780 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845783 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845786 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845789 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845791 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845794 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845796 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845799 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845803 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845805 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845808 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845811 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845814 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845817 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845819 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845822 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845824 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845827 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845829 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845832 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.855802 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845834 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845837 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845839 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845842 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845844 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845847 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845849 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845852 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845854 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845857 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845859 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845862 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845865 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845867 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845870 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845872 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845875 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845877 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845880 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845882 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.856272 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845886 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845890 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845894 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845897 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845900 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845902 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845905 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845908 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845910 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845914 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845917 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845919 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845922 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845924 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845927 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845930 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845932 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845935 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.856780 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845937 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845940 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845942 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845945 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845947 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845950 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845953 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845956 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845959 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845961 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845964 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845967 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845969 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845972 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845976 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845979 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845981 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845984 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845986 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845989 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.857208 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845992 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.845999 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846001 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846004 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846007 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846010 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846012 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846015 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846017 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846020 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846022 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846025 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846027 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846030 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846032 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846035 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846037 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846040 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846042 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.857685 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846045 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846048 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846050 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846053 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846055 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846059 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846061 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.846065 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.853190 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.853205 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.854165 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.854172 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854243 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854248 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854252 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854255 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854257 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854260 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854263 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854265 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.858130 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854268 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854271 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854274 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854276 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854279 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854282 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854285 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854287 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854290 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854293 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854296 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854298 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854308 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854311 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854313 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854316 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854319 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854322 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854324 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854327 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.858603 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854330 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854332 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854335 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854338 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854340 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854343 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854345 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854348 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854350 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854353 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854355 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854358 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854360 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854363 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854365 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854368 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854370 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854374 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854376 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854379 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.859113 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854381 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854384 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854386 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854389 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854391 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854400 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854402 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854405 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854407 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854410 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854412 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854415 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854417 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854420 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854422 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854424 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854427 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854429 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854432 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854435 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.859905 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854437 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854439 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854442 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854446 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854450 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854452 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854455 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854457 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854460 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854464 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854466 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854469 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854471 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854474 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854476 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854479 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854481 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854484 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854492 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.860368 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854495 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854497 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854500 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854502 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854504 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854507 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854509 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854512 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854520 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854524 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854528 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854531 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854534 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854537 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854539 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854542 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854559 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854562 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.860828 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854565 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.854593 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854802 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854807 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854811 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854815 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854817 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854820 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854823 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854826 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854828 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854830 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854833 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854836 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854844 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854847 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854849 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.861246 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854851 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854854 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854856 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854859 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854861 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854863 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854866 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854868 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854871 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854873 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854875 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854878 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854880 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854883 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854886 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854888 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854891 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854893 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854896 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854898 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.861662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854901 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854903 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854906 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854908 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854911 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854913 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854916 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854918 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854921 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854923 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854931 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854934 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854936 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854950 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854954 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854957 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854959 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854962 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854964 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.862187 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854967 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854970 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854974 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854977 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854979 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854982 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854985 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854987 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854989 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854992 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854994 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854997 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.854999 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855002 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855004 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855007 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855009 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855011 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855014 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.862655 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855016 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855019 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855021 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855023 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855026 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855035 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855038 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855040 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855043 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855045 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855047 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855050 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855052 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855055 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855057 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855060 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855062 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855065 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855068 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.863101 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855070 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855073 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855075 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855078 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855082 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855085 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855088 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855091 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855093 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855096 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855098 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855100 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855103 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855106 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.855128 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:06:16.863590 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855172 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855177 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855180 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855182 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855191 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855194 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855196 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855199 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855201 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855204 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855206 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855209 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855211 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855213 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855216 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855218 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855221 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855223 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855226 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855228 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855231 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:06:16.863946 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855233 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855236 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855238 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855241 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855243 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855246 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855248 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855250 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855253 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855255 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855258 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855260 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855263 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855265 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855267 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855270 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855278 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855280 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855283 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:06:16.864423 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855285 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855288 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855291 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855293 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855298 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855301 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855303 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855306 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855308 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855311 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855313 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855316 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855318 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855322 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855326 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855329 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855332 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855334 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855337 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:06:16.864961 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855340 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855343 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855345 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855347 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855350 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855352 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855355 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855357 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855360 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855362 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855365 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855373 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855376 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855378 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855380 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855383 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855386 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855389 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855392 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:06:16.865407 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855395 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855398 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855400 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855403 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855405 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855408 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855411 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855413 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855416 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855418 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855421 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855423 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855426 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855428 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855431 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855433 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855437 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855441 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855444 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:06:16.865863 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855447 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855449 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855452 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855455 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855457 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855460 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855468 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855472 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:16.855474 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.855529 2576 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.858166 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.859533 2576 server.go:1014] "Starting client certificate rotation" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.859938 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.859971 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.863187 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 14:06:16.866322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.864317 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 14:06:16.876256 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.876238 2576 log.go:25] "Validated CRI v1 runtime API" Oct 30 14:06:16.879142 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.879128 2576 log.go:25] "Validated CRI v1 image API" Oct 30 14:06:16.880093 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.880068 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 14:06:16.884224 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.884204 2576 fs.go:135] Filesystem UUIDs: map[3f5f2f1f-e3c8-48c3-b7b1-7148b644db41:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f539c554-e07a-4021-9c6e-39c8ca6dc427:/dev/nvme0n1p3] Oct 30 14:06:16.884287 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.884224 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 14:06:16.889614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.889489 2576 manager.go:217] Machine: {Timestamp:2026-10-30 14:06:16.888205951 +0000 UTC m=+0.330313500 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099935 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2968b492b3fd202a30eabfaa78e705 SystemUUID:ec2968b4-92b3-fd20-2a30-eabfaa78e705 BootID:cf4175e9-b39e-4cbd-b1c5-5fa51b4bc540 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f9:b9:3e:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f9:b9:3e:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:bf:01:89:cb:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 14:06:16.890034 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.890024 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 14:06:16.890150 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.890139 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 14:06:16.891208 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891185 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 14:06:16.891351 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891210 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 14:06:16.891391 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891353 2576 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 14:06:16.891391 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891361 2576 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 14:06:16.891445 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891392 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 14:06:16.891445 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.891409 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 14:06:16.892018 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.892008 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 14:06:16.895343 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.895330 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 14:06:16.895458 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.895449 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 14:06:16.896393 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896383 2576 kubelet.go:493] "Attempting to sync node with API server" Oct 30 14:06:16.896432 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896397 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 14:06:16.896432 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896407 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 14:06:16.896432 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896417 2576 kubelet.go:405] "Adding apiserver pod source" Oct 30 14:06:16.896432 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896425 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 14:06:16.896726 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.896716 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 14:06:16.898994 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.898973 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 14:06:16.903571 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.903539 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 14:06:16.904257 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904244 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 14:06:16.904303 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904276 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 14:06:16.904452 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904441 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 14:06:16.904486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904459 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 14:06:16.904486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904465 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 14:06:16.904486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904470 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 14:06:16.904486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904476 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 14:06:16.904486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.904482 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 14:06:16.905043 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905033 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 14:06:16.905043 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905043 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 14:06:16.905115 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905050 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 14:06:16.905115 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905056 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 14:06:16.905115 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905065 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 14:06:16.905115 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905075 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 14:06:16.905788 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905775 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 14:06:16.905788 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.905788 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 14:06:16.909489 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.909475 2576 server.go:1263] "Started kubelet" Oct 30 14:06:16.909578 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.909540 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 14:06:16.909663 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.909615 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 14:06:16.909699 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.909681 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 14:06:16.910315 ip-10-0-130-107 systemd[1]: Started Kubernetes Kubelet. Oct 30 14:06:16.910764 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.910748 2576 server.go:317] "Adding debug handlers to kubelet server" Oct 30 14:06:16.913502 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.913483 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 14:06:16.916212 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.916193 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 14:06:16.917719 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.917699 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 14:06:16.918605 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.918590 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 14:06:16.918732 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.918687 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:16.919474 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919459 2576 factory.go:55] Registering systemd factory Oct 30 14:06:16.919474 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919477 2576 factory.go:223] Registration of the systemd container factory successfully Oct 30 14:06:16.919723 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919709 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 14:06:16.919830 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919812 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 14:06:16.919925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919705 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 14:06:16.919925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919720 2576 factory.go:153] Registering CRI-O factory Oct 30 14:06:16.919925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919887 2576 factory.go:223] Registration of the crio container factory successfully Oct 30 14:06:16.920068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919927 2576 reconstruct.go:97] "Volume reconstruction finished" Oct 30 14:06:16.920068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919934 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 14:06:16.920068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919951 2576 factory.go:103] Registering Raw factory Oct 30 14:06:16.920068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919961 2576 manager.go:1199] Started watching for new ooms in manager Oct 30 14:06:16.920068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.919935 2576 reconciler.go:29] "Reconciler: start to sync state" Oct 30 14:06:16.920759 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.920744 2576 manager.go:319] Starting recovery of all containers Oct 30 14:06:16.931061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.931044 2576 manager.go:324] Recovery completed Oct 30 14:06:16.936286 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.936269 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:16.937930 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.937903 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:16.937998 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.937944 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:16.937998 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.937959 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:16.938470 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.938459 2576 cpu_manager.go:226] "Starting" policy="none" Oct 30 14:06:16.938470 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.938468 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 14:06:16.938622 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.938474 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:16.938622 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.938484 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 14:06:16.939218 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.939202 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:16.939283 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.939232 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:16.939283 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.939241 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:16.940648 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.940636 2576 policy_none.go:50] "Start" Oct 30 14:06:16.940711 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.940656 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 14:06:16.940711 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.940665 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 14:06:16.942645 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.942634 2576 policy_none.go:44] "Start" Oct 30 14:06:16.946979 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.946954 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 14:06:16.946979 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.946949 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 14:06:16.948089 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.946949 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-107.ec2.internal.18e353c3c4d27699 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-107.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-107.ec2.internal,},FirstTimestamp:2026-10-30 14:06:16.909444761 +0000 UTC m=+0.351552292,LastTimestamp:2026-10-30 14:06:16.909444761 +0000 UTC m=+0.351552292,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-107.ec2.internal,}" Oct 30 14:06:16.954499 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.954482 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 14:06:16.957093 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.957072 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdpjf" Oct 30 14:06:16.966686 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.966601 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-107.ec2.internal.18e353c3c6851bb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-107.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-107.ec2.internal,},FirstTimestamp:2026-10-30 14:06:16.937929655 +0000 UTC m=+0.380037186,LastTimestamp:2026-10-30 14:06:16.937929655 +0000 UTC m=+0.380037186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-107.ec2.internal,}" Oct 30 14:06:16.967173 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.967147 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 14:06:16.967238 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.967149 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 14:06:16.969685 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.969669 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdpjf" Oct 30 14:06:16.984714 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.984682 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 14:06:16.987380 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.987362 2576 manager.go:341] "Starting Device Plugin manager" Oct 30 14:06:16.987435 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.987408 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 14:06:16.987435 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.987418 2576 server.go:87] "Starting device plugin registration server" Oct 30 14:06:16.987829 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.987688 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 14:06:16.987904 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.987880 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 14:06:16.988112 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.988091 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 14:06:16.988259 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.988172 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 14:06:16.988259 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.988182 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 14:06:16.988673 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.988655 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 14:06:16.988768 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:16.988704 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:16.996940 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:16.996922 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:17.056140 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.056111 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 14:06:17.058144 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.057654 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 14:06:17.058144 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.057672 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 14:06:17.058144 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.057687 2576 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 14:06:17.058144 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.057720 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 14:06:17.071827 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.071809 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:17.088053 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.088006 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:17.088858 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.088843 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:17.088925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.088872 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:17.088925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.088896 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:17.088925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.088921 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.107948 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.107930 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.108014 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.107949 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-107.ec2.internal\": node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.157870 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.157837 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal"] Oct 30 14:06:17.158022 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.157918 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:17.158387 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.158363 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.158813 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.158800 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:17.158877 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.158828 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:17.158877 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.158837 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:17.161063 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161051 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:17.161262 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.161333 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161307 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:17.161713 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161695 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:17.161807 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161722 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:17.161807 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.161737 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:17.162172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.162159 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:17.162218 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.162198 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:17.162251 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.162223 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:17.163796 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.163780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.163886 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.163812 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:17.164529 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.164508 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:17.164641 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.164536 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:17.164641 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.164561 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:17.195076 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.195059 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-107.ec2.internal\" not found" node="ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.198244 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.198227 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-107.ec2.internal\" not found" node="ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.221562 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.221524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.221651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.221568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.221651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.221589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.259027 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.259004 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.321966 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.321939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.322068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.321993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.322068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.322023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.322068 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.322049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.322180 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.322074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.322180 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.322103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.359637 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.359592 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.460556 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.460507 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.497735 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.497699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.500848 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.500831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:17.561538 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.561510 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.662112 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.662049 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.762597 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.762570 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.859216 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.859188 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 14:06:17.859626 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.859341 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 14:06:17.859626 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.859353 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 14:06:17.863351 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.863312 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.963875 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:17.963849 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:17.974682 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.974644 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 14:01:17 +0000 UTC" deadline="2028-07-02 16:50:56.103922557 +0000 UTC" Oct 30 14:06:17.974682 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:17.974671 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14666h44m38.129255006s" Oct 30 14:06:17.995286 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:17.995244 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a8f48498ec66db0afb340acba0d0bb.slice/crio-9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b WatchSource:0}: Error finding container 9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b: Status 404 returned error can't find the container with id 9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b Oct 30 14:06:18.000349 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.000331 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:06:18.010979 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.010962 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:06:18.011783 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.011764 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:06:18.011847 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.011805 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:06:18.011847 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.011815 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:06:18.060759 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.060702 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerStarted","Data":"80a35ec6769b02a0d2602c3d9b9e2b16ad5bd298eaafaa8f02329dffeeab3652"} Oct 30 14:06:18.061749 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.061724 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"22a8f48498ec66db0afb340acba0d0bb","Type":"ContainerStarted","Data":"9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b"} Oct 30 14:06:18.063966 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.063948 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:18.164498 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.164472 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:18.242393 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.242318 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:18.265323 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.265301 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:18.366060 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.366020 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:18.466702 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.466673 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:06:18.509313 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.509238 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:18.519244 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.519218 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:06:18.544487 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.544440 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:06:18.545570 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.545536 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:06:18.568852 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.568829 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:06:18.898374 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.898287 2576 apiserver.go:52] "Watching apiserver" Oct 30 14:06:18.919355 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.919044 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 14:06:18.947833 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.947799 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 14:06:18.948176 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.948147 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-77dqh","openshift-cluster-node-tuning-operator/tuned-wx4xb","openshift-multus/multus-additional-cni-plugins-zg69v","openshift-network-diagnostics/network-check-target-lbktj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv","openshift-dns/node-resolver-7kq6l","openshift-image-registry/node-ca-fvjpk","openshift-multus/network-metrics-daemon-bppvh","openshift-network-operator/iptables-alerter-pp976","kube-system/global-pull-secret-syncer-fjb5h","kube-system/konnectivity-agent-c558z","kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal","openshift-multus/multus-cllh7"] Oct 30 14:06:18.951066 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.951037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:18.953532 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.953509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:18.956156 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.956130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:18.958512 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.958492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:18.958634 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.958584 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:18.961364 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.961342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:18.963582 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.963540 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:18.966014 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.965990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:18.969366 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.968481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cllh7" Oct 30 14:06:18.970113 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.970014 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvlg\"" Oct 30 14:06:18.970790 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.970767 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 14:06:18.971024 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.970992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:18.972044 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.972022 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 14:06:18.972147 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.972044 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 14:06:18.972147 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.972115 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 14:06:18.973281 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.973258 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5nrs\"" Oct 30 14:06:18.973417 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.973402 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 14:06:18.974821 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.974572 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94q7c\"" Oct 30 14:06:18.975294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.975276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:18.975402 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.975366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:18.979307 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.979284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:18.981906 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.981888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:18.981996 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:18.981952 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:18.983346 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.983327 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 14:06:18.983431 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.983387 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnjzj" Oct 30 14:06:18.987567 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:18.987531 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnjzj" Oct 30 14:06:19.021148 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.021125 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 14:06:19.033321 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.033420 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.033420 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.033531 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.033531 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.033655 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.033655 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.033655 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.033798 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.033798 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.033798 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.033798 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.033798 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.033988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcjw\" (UniqueName: \"kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.034020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdjh\" (UniqueName: \"kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.034358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th48w\" (UniqueName: \"kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.034875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.034951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8tg\" (UniqueName: \"kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vtz9\" (UniqueName: \"kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllzl\" (UniqueName: \"kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.035383 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035634 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrd7\" (UniqueName: \"kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.036198 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.035992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584jq\" (UniqueName: \"kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dds65\" (UniqueName: \"kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.037023 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.036188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.077476 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.077449 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:19.078882 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078855 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078881 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078895 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078895 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078930 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.078950 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 14:06:19.079009 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079009 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 14:06:19.079314 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079031 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.079314 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079076 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.079416 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079384 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.079416 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079386 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mlbs5\"" Oct 30 14:06:19.079519 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079418 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 14:06:19.079519 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079470 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 14:06:19.079519 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079472 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 14:06:19.079519 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079501 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.079519 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079508 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 14:06:19.079781 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079521 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.079781 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079519 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 14:06:19.079781 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079584 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mfmhk\"" Oct 30 14:06:19.079781 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.079698 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5t6gk\"" Oct 30 14:06:19.093634 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.093611 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.093743 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.093650 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094399 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094460 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094485 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w5lxm\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094642 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkz6n\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094707 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dqvfb\"" Oct 30 14:06:19.094769 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.094739 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 14:06:19.137371 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137515 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.137888 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.137930 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.138019 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:19.637980473 +0000 UTC m=+3.080088010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138031 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.137821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.138495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcjw\" (UniqueName: \"kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138463 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdjh\" (UniqueName: \"kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138705 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.139276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138891 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138956 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.138993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.140107 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139198 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th48w\" (UniqueName: \"kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8tg\" (UniqueName: \"kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtz9\" (UniqueName: \"kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139815 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllzl\" (UniqueName: \"kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.139961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140148 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.141922 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.140660 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.140730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:19.640712924 +0000 UTC m=+3.082820459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.140995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141116 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrd7\" (UniqueName: \"kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.142880 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584jq\" (UniqueName: \"kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dds65\" (UniqueName: \"kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.143961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.141974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142014 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.142873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.143076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.144822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.143181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.145565 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.145545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.147080 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.146986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.167349 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.167251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcjw\" (UniqueName: \"kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.167493 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.167429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdjh\" (UniqueName: \"kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.169322 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.169300 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:19.169322 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.169325 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:19.169502 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.169337 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:19.169502 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.169395 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:19.669379526 +0000 UTC m=+3.111487064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:19.169786 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.169763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th48w\" (UniqueName: \"kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.170271 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.169952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8tg\" (UniqueName: \"kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.170446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.170390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllzl\" (UniqueName: \"kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.171957 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.171934 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:06:19.172079 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.172025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dds65\" (UniqueName: \"kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.172656 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.172601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtz9\" (UniqueName: \"kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.173266 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.173240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrd7\" (UniqueName: \"kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.174318 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.174290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584jq\" (UniqueName: \"kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.267702 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.267666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:06:19.278952 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.278922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:19.281201 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.281167 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210c5840_d339_472c_bf93_70d3b994ef0b.slice/crio-9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece WatchSource:0}: Error finding container 9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece: Status 404 returned error can't find the container with id 9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece Oct 30 14:06:19.290399 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.290373 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa727ec_4c77_4e70_ad45_9628aff7ce9d.slice/crio-f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419 WatchSource:0}: Error finding container f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419: Status 404 returned error can't find the container with id f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419 Oct 30 14:06:19.300667 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.300621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:06:19.306145 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.306120 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:06:19.308102 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.308075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:06:19.311894 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.311872 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:06:19.316352 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.316318 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd776f9ca_7234_4de9_afb1_5cba943b3e33.slice/crio-ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5 WatchSource:0}: Error finding container ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5: Status 404 returned error can't find the container with id ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5 Oct 30 14:06:19.320311 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.320291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cllh7" Oct 30 14:06:19.321698 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.321672 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2ded23_31d3_4ca7_9c8f_b3436f857e34.slice/crio-84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a WatchSource:0}: Error finding container 84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a: Status 404 returned error can't find the container with id 84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a Oct 30 14:06:19.327223 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.327173 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12480bb8_63a0_46b7_8c80_77a003039963.slice/crio-0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4 WatchSource:0}: Error finding container 0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4: Status 404 returned error can't find the container with id 0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4 Oct 30 14:06:19.328965 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.328940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:06:19.331806 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.331694 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd8ba1d_4b02_436e_a3b4_dedb4b08040f.slice/crio-5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f WatchSource:0}: Error finding container 5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f: Status 404 returned error can't find the container with id 5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f Oct 30 14:06:19.336126 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.336097 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd6acf7_9d06_4623_bc36_3935d1f26ee0.slice/crio-f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643 WatchSource:0}: Error finding container f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643: Status 404 returned error can't find the container with id f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643 Oct 30 14:06:19.342662 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.342642 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f9d7ce_b54f_4909_8d21_53830a34f0a5.slice/crio-652c451a7770d56ab6a550af0cd9f353fd367b2f1093dd5038700349fc6a2b6d WatchSource:0}: Error finding container 652c451a7770d56ab6a550af0cd9f353fd367b2f1093dd5038700349fc6a2b6d: Status 404 returned error can't find the container with id 652c451a7770d56ab6a550af0cd9f353fd367b2f1093dd5038700349fc6a2b6d Oct 30 14:06:19.351834 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.351807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:19.360645 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:06:19.360615 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a99d162_1cc9_4a27_8ecc_ac790e658369.slice/crio-9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87 WatchSource:0}: Error finding container 9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87: Status 404 returned error can't find the container with id 9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87 Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.644913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.644974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.645033 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.645070 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.645107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:20.645085274 +0000 UTC m=+4.087192797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:19.645119 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.645126 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:20.645118254 +0000 UTC m=+4.087225774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:19.746529 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.746436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:19.747003 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.746632 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:19.747003 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.746660 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:19.747003 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.746673 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:19.747003 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:19.746744 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:20.746722159 +0000 UTC m=+4.188829681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:19.991361 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.991283 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:19 +0000 UTC" deadline="2028-05-17 06:41:13.770891187 +0000 UTC" Oct 30 14:06:19.991361 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:19.991360 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13552h34m53.779536401s" Oct 30 14:06:20.058635 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.058316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:20.058864 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.058724 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:20.074659 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.073757 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7ee2a181ecea111d0e2dddc4fd43090" containerID="2ffeb9509b0e014d8ac71df5fc145c79c303a31aedba1273ca35366abe812f4b" exitCode=0 Oct 30 14:06:20.074659 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.073853 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerDied","Data":"2ffeb9509b0e014d8ac71df5fc145c79c303a31aedba1273ca35366abe812f4b"} Oct 30 14:06:20.080776 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.079981 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"22a8f48498ec66db0afb340acba0d0bb","Type":"ContainerStarted","Data":"0f5e08209070d418ed80422f1be948c053ee8e1a3ad8151e91d306d151e15f9c"} Oct 30 14:06:20.115413 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.115380 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87"} Oct 30 14:06:20.123344 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.122780 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pp976" event={"ID":"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f","Type":"ContainerStarted","Data":"5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f"} Oct 30 14:06:20.137862 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.137830 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" event={"ID":"5e2ded23-31d3-4ca7-9c8f-b3436f857e34","Type":"ContainerStarted","Data":"84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a"} Oct 30 14:06:20.151720 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.151688 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerStarted","Data":"ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5"} Oct 30 14:06:20.163596 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.163520 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" event={"ID":"62f9d7ce-b54f-4909-8d21-53830a34f0a5","Type":"ContainerStarted","Data":"652c451a7770d56ab6a550af0cd9f353fd367b2f1093dd5038700349fc6a2b6d"} Oct 30 14:06:20.185989 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.185957 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cllh7" event={"ID":"5fd6acf7-9d06-4623-bc36-3935d1f26ee0","Type":"ContainerStarted","Data":"f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643"} Oct 30 14:06:20.198942 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.198909 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7kq6l" event={"ID":"12480bb8-63a0-46b7-8c80-77a003039963","Type":"ContainerStarted","Data":"0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4"} Oct 30 14:06:20.206355 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.206325 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c558z" event={"ID":"dfa727ec-4c77-4e70-ad45-9628aff7ce9d","Type":"ContainerStarted","Data":"f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419"} Oct 30 14:06:20.208617 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.208472 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvjpk" event={"ID":"210c5840-d339-472c-bf93-70d3b994ef0b","Type":"ContainerStarted","Data":"9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece"} Oct 30 14:06:20.654564 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.654474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:20.654768 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.654576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:20.654841 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.654766 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:20.654841 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.654836 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:22.654816109 +0000 UTC m=+6.096923645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:20.655701 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.655599 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:20.660411 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.659969 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:22.659947796 +0000 UTC m=+6.102055336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:20.755852 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.755811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:20.756053 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.755992 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:20.756053 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.756015 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:20.756053 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.756029 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:20.756219 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:20.756089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:22.756070639 +0000 UTC m=+6.198178162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:20.992429 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.992335 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:19 +0000 UTC" deadline="2028-05-19 17:41:25.35992937 +0000 UTC" Oct 30 14:06:20.992429 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:20.992427 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13611h35m4.367507057s" Oct 30 14:06:21.061050 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:21.061015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:21.061237 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:21.061175 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:21.061609 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:21.061586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:21.061735 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:21.061714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:21.258500 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:21.258412 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerStarted","Data":"4837306d7808908f0bd1912b97996a40601ea0776ab058de267731a4185dde3c"} Oct 30 14:06:21.307322 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:21.307257 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" podStartSLOduration=3.307237176 podStartE2EDuration="3.307237176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:20.173005437 +0000 UTC m=+3.615112996" watchObservedRunningTime="2026-10-30 14:06:21.307237176 +0000 UTC m=+4.749344721" Oct 30 14:06:21.307657 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:21.307361 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" podStartSLOduration=3.307354821 podStartE2EDuration="3.307354821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:21.306147482 +0000 UTC m=+4.748255025" watchObservedRunningTime="2026-10-30 14:06:21.307354821 +0000 UTC m=+4.749462367" Oct 30 14:06:22.058427 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:22.058386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:22.058969 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.058528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:22.679134 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:22.679092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:22.679315 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:22.679175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:22.679393 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.679323 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:22.679393 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.679388 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:26.67937049 +0000 UTC m=+10.121478025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:22.679519 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.679456 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:22.679519 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.679491 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:26.679479917 +0000 UTC m=+10.121587443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:22.781203 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:22.780512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:22.781203 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.780746 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:22.781203 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.780772 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:22.781203 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.780785 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:22.781203 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:22.780847 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:26.780828326 +0000 UTC m=+10.222935862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:23.059866 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:23.059832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:23.060328 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:23.059888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:23.060328 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:23.059984 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:23.060493 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:23.060462 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:23.285762 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:23.285342 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="674c86991b481e9a3b8366f3980e2f10d834e92baa2e8a7253be43af531d877a" exitCode=0 Oct 30 14:06:23.285762 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:23.285482 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"674c86991b481e9a3b8366f3980e2f10d834e92baa2e8a7253be43af531d877a"} Oct 30 14:06:23.295418 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:23.295028 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c558z" event={"ID":"dfa727ec-4c77-4e70-ad45-9628aff7ce9d","Type":"ContainerStarted","Data":"de17cfad1b974ff2b7343bb468b1118cbb18844d04131029c3b0d336ab6b8691"} Oct 30 14:06:24.059339 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:24.058738 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:24.059339 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:24.058866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:25.060125 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.058671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:25.060125 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:25.058799 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:25.060125 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.059174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:25.060125 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:25.059278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:25.308674 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.308081 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvjpk" event={"ID":"210c5840-d339-472c-bf93-70d3b994ef0b","Type":"ContainerStarted","Data":"8de9c703f96066f765886a4a7a94367792260f5f8c475e43eb199306a03b4821"} Oct 30 14:06:25.312760 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.312717 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" event={"ID":"5e2ded23-31d3-4ca7-9c8f-b3436f857e34","Type":"ContainerStarted","Data":"945cc6f14eb6707b3e9b95cd6ef73d9d056cd1b9731a0cc10b5d03d08fb407cc"} Oct 30 14:06:25.352590 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.352396 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fvjpk" podStartSLOduration=3.143753638 podStartE2EDuration="8.352379249s" totalImagesPullingTime="5.208625611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:25.351905414 +0000 UTC m=+8.794012955" watchObservedRunningTime="2026-10-30 14:06:25.352379249 +0000 UTC m=+8.794486790" Oct 30 14:06:25.352873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:25.352700 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c558z" podStartSLOduration=4.726903855 podStartE2EDuration="8.35268592s" totalImagesPullingTime="3.625782065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:23.419313433 +0000 UTC m=+6.861420977" watchObservedRunningTime="2026-10-30 14:06:25.35268592 +0000 UTC m=+8.794793460" Oct 30 14:06:26.058568 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.058524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:26.058703 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.058649 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:26.536863 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.536831 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:26.537959 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.537933 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:26.686002 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.685973 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 14:06:26.730472 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.730441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:26.730661 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.730512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:26.730758 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.730674 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:26.730758 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.730744 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:34.730717559 +0000 UTC m=+18.172825103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:26.731148 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.731114 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:26.731252 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.731166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:34.73115011 +0000 UTC m=+18.173257891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:26.832246 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.831498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:26.832246 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.831728 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:26.832246 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.831755 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:26.832246 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.831769 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:26.832246 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:26.831831 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:34.831812393 +0000 UTC m=+18.273919915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:26.992434 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.992285 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T14:06:26.685997175Z","UUID":"82a7bc81-e986-419c-9039-7992e7b9a6b9","Handler":null,"Name":"","Endpoint":""} Oct 30 14:06:26.994402 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.994377 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 14:06:26.994561 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:26.994411 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 14:06:27.062045 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:27.061273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:27.062045 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:27.061417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:27.062045 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:27.061503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:27.062045 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:27.061644 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:27.324472 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:27.324376 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" event={"ID":"5e2ded23-31d3-4ca7-9c8f-b3436f857e34","Type":"ContainerStarted","Data":"1d3401d6a73773fb6a134240d01758b8dbb16ccbaeb57c9ec218cc56387c36d8"} Oct 30 14:06:27.328656 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:27.328628 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cllh7" event={"ID":"5fd6acf7-9d06-4623-bc36-3935d1f26ee0","Type":"ContainerStarted","Data":"b566b61a9a00374ccd61b9eac4f23067cfb91539057d367910b0e27656e14b75"} Oct 30 14:06:28.058086 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.058049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:28.058499 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:28.058180 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:28.335597 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.335535 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" event={"ID":"5e2ded23-31d3-4ca7-9c8f-b3436f857e34","Type":"ContainerStarted","Data":"ced51cebc2a883f7603c79d55924e98b82c107d5b1d26ccdbc38edff093cb3cc"} Oct 30 14:06:28.339183 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.339146 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="a55cc1aca4eb45827ff7e84aa2eff69144470f197411913e22c524dda5523e04" exitCode=0 Oct 30 14:06:28.339330 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.339231 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"a55cc1aca4eb45827ff7e84aa2eff69144470f197411913e22c524dda5523e04"} Oct 30 14:06:28.342618 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.342595 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7kq6l" event={"ID":"12480bb8-63a0-46b7-8c80-77a003039963","Type":"ContainerStarted","Data":"991b9eff4b5014152aa084f97cdd495b1bee79b5b04283823aebe67401700f7c"} Oct 30 14:06:28.383158 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.383094 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cllh7" podStartSLOduration=3.6649402 podStartE2EDuration="11.383074615s" totalImagesPullingTime="7.718134415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:27.377285961 +0000 UTC m=+10.819393505" watchObservedRunningTime="2026-10-30 14:06:28.383074615 +0000 UTC m=+11.825182173" Oct 30 14:06:28.383525 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.383503 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" podStartSLOduration=3.179147462 podStartE2EDuration="11.383498017s" totalImagesPullingTime="8.204350555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:28.38289984 +0000 UTC m=+11.825007407" watchObservedRunningTime="2026-10-30 14:06:28.383498017 +0000 UTC m=+11.825605556" Oct 30 14:06:28.426333 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:28.426275 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-7kq6l" podStartSLOduration=3.141185175 podStartE2EDuration="11.426262132s" totalImagesPullingTime="8.285076957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:28.425852597 +0000 UTC m=+11.867960134" watchObservedRunningTime="2026-10-30 14:06:28.426262132 +0000 UTC m=+11.868369673" Oct 30 14:06:29.058074 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:29.057998 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:29.058234 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:29.058118 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:29.058667 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:29.058289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:29.058667 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:29.058372 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:29.346891 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:29.346803 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pp976" event={"ID":"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f","Type":"ContainerStarted","Data":"ea22c47fe9b1bcba08faa023448a0a66bb9ff138c06f473f3cd5cb5af97d88f7"} Oct 30 14:06:29.391319 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:29.391262 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pp976" podStartSLOduration=4.556608302 podStartE2EDuration="12.391244688s" totalImagesPullingTime="7.834636386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:29.391075701 +0000 UTC m=+12.833183242" watchObservedRunningTime="2026-10-30 14:06:29.391244688 +0000 UTC m=+12.833352230" Oct 30 14:06:30.058536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:30.058314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:30.059007 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:30.058633 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:30.350694 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:30.350607 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" event={"ID":"62f9d7ce-b54f-4909-8d21-53830a34f0a5","Type":"ContainerStarted","Data":"1a271d3d80c48405cdb699429432c8d4d17db2ebc3072d46f2625f96d71646e2"} Oct 30 14:06:30.355052 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:30.355019 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="103544bb16af72d67928ffdeecaf9faaaa7fdfd4cfc574f6b3b07033868a0684" exitCode=0 Oct 30 14:06:30.355221 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:30.355101 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"103544bb16af72d67928ffdeecaf9faaaa7fdfd4cfc574f6b3b07033868a0684"} Oct 30 14:06:30.397940 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:30.397886 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" podStartSLOduration=2.975684062 podStartE2EDuration="13.397870898s" totalImagesPullingTime="10.422186836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:30.397719749 +0000 UTC m=+13.839827291" watchObservedRunningTime="2026-10-30 14:06:30.397870898 +0000 UTC m=+13.839978437" Oct 30 14:06:31.058469 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:31.058440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:31.058626 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:31.058593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:31.059100 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:31.058669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:31.059100 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:31.058775 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:31.360962 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:31.360881 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="f6f67038a670fc8e62866a1550530842c9af1d0498725473a14d6b878425c09b" exitCode=0 Oct 30 14:06:31.361101 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:31.360978 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"f6f67038a670fc8e62866a1550530842c9af1d0498725473a14d6b878425c09b"} Oct 30 14:06:32.058634 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:32.058594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:32.059157 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:32.058733 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:33.058635 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:33.058596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:33.058803 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:33.058736 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:33.058803 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:33.058788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:33.059339 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:33.058903 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:33.369562 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:33.369506 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerStarted","Data":"61209618cfc2558b116cdbccb7be1480b146d2fb29a49e8803f817b9dd1f207e"} Oct 30 14:06:33.663349 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:33.663276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:33.915012 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:33.914982 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:34.057978 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.057804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:34.058134 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.058044 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:34.373508 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.373480 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"1505c3c3b751276e546f2fe871d1b5c05c0699dbb216acae4519d106d4416d85"} Oct 30 14:06:34.373921 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.373619 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"abe60e3b1943dca8185dad8d7962dbc056efbd49ddce4d6b6a745362dd017c94"} Oct 30 14:06:34.373921 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.373676 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"44b8ee668b0b990aad764cf87f169d3bab82f8a77c000118365ed17be3a79f69"} Oct 30 14:06:34.376450 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.376428 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="61209618cfc2558b116cdbccb7be1480b146d2fb29a49e8803f817b9dd1f207e" exitCode=0 Oct 30 14:06:34.376526 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.376462 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"61209618cfc2558b116cdbccb7be1480b146d2fb29a49e8803f817b9dd1f207e"} Oct 30 14:06:34.794779 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.794514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:34.794779 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.794772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:34.794955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.794656 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:34.794955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.794865 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:50.794845865 +0000 UTC m=+34.236953404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:34.794955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.794880 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:34.794955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.794911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:06:50.7949019 +0000 UTC m=+34.237009436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:34.895192 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:34.895162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:34.895332 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.895317 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:34.895367 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.895337 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:34.895367 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.895347 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:34.895420 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:34.895392 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:06:50.89537911 +0000 UTC m=+34.337486628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:35.058207 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.058132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:35.058344 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:35.058262 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:35.058344 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.058309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:35.058416 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:35.058387 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:35.380980 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.380901 2576 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="30df964a19499bd7606caf452647545665736212480d1a6862ba30a1af831339" exitCode=0 Oct 30 14:06:35.381410 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.380989 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerDied","Data":"30df964a19499bd7606caf452647545665736212480d1a6862ba30a1af831339"} Oct 30 14:06:35.384174 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.384156 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"4cbc8cf623fa8edb85b78b44ee3b3275019f52e7cc881777cea9081a4ef544a9"} Oct 30 14:06:35.384235 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.384208 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"906ece3301874a2a869d69cf95d6821c1bf887463e802535315cf7ede60501d1"} Oct 30 14:06:35.384267 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.384238 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"6b42d276bb0e33e66cf7b88f460c3c30961876ebd350b4332dfd0071b1474fe4"} Oct 30 14:06:35.607953 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.607923 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:35.608089 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.608061 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 14:06:35.608471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.608444 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:06:35.761682 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.761649 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:35.904311 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:35.904278 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:36.058358 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:36.058282 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:36.058501 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:36.058367 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:36.390904 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:36.390784 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zg69v" event={"ID":"d776f9ca-7234-4de9-afb1-5cba943b3e33","Type":"ContainerStarted","Data":"942ec3540d2949ba93ed86c9dfe0b284e516b673773c01163ea8de5c761f46ef"} Oct 30 14:06:36.441903 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:36.441859 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zg69v" podStartSLOduration=8.642513805 podStartE2EDuration="19.441846352s" totalImagesPullingTime="10.799332547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:36.441525865 +0000 UTC m=+19.883633404" watchObservedRunningTime="2026-10-30 14:06:36.441846352 +0000 UTC m=+19.883953899" Oct 30 14:06:37.058933 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:37.058897 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:37.059074 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:37.058990 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:37.059109 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:37.059080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:37.059191 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:37.059174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:37.262825 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:37.262794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:37.395847 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:37.395759 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"7378e8f377143841b1e87aa486a3b2bf57315b36e239569021ab0132122ff0a9"} Oct 30 14:06:37.411676 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:37.411648 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:38.058835 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:38.058803 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:38.058991 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:38.058903 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:39.059061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.058982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:39.059061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.059025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:39.059726 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:39.059121 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:39.059726 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:39.059202 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:39.403945 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.403645 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" event={"ID":"2a99d162-1cc9-4a27-8ecc-ac790e658369","Type":"ContainerStarted","Data":"976b2449c53c7a35375c93665427b3c62b12e1d47f3d6d94d3b961ffc53fc704"} Oct 30 14:06:39.404105 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.403959 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:39.404105 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.404009 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:39.419820 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.419792 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:39.424989 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.424969 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:39.501961 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.501909 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" podStartSLOduration=7.686095036 podStartE2EDuration="22.501896241s" totalImagesPullingTime="14.815801205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:06:39.501360224 +0000 UTC m=+22.943467763" watchObservedRunningTime="2026-10-30 14:06:39.501896241 +0000 UTC m=+22.944003783" Oct 30 14:06:39.916710 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:39.916674 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:40.057931 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.057899 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:40.058082 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:40.058003 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:40.058410 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.058378 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:40.405809 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.405741 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 14:06:40.844237 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.844057 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbktj"] Oct 30 14:06:40.844237 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.844177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:40.844462 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:40.844269 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:40.845275 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.845252 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjb5h"] Oct 30 14:06:40.845412 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.845332 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:40.845412 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:40.845406 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:40.846844 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.846821 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bppvh"] Oct 30 14:06:40.846944 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.846908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:40.846996 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:40.846981 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:40.902995 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:40.902969 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:41.055110 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.055074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:41.219157 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.219129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:41.358970 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.358937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:41.407720 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.407696 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 14:06:41.816686 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.816653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:41.965957 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:41.965929 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:42.058276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:42.058248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:42.058276 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:42.058263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:42.058438 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:42.058366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:42.058497 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:42.058479 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:42.592514 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:42.592476 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:43.058036 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:43.058013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:43.058183 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:43.058111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:43.759685 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:43.759653 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:06:43.760214 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:43.759824 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 14:06:43.771056 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:43.771020 2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" podUID="2a99d162-1cc9-4a27-8ecc-ac790e658369" containerName="ovnkube-controller" probeResult="failure" output="" Oct 30 14:06:43.779628 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:43.779598 2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" podUID="2a99d162-1cc9-4a27-8ecc-ac790e658369" containerName="ovnkube-controller" probeResult="failure" output="" Oct 30 14:06:44.058675 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:44.058600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:44.058825 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:44.058708 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:44.058825 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:44.058734 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:44.058825 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:44.058805 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:44.718732 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:44.718701 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:45.044073 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:45.044044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:45.057935 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:45.057905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:45.058058 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:45.058021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:45.332753 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:45.332659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:45.481190 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:45.481149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:46.058873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.058828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:46.058873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.058861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:46.059386 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:46.058967 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:46.059386 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:46.059128 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:46.334707 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.334631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:46.487622 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.487587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:46.635633 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.635535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:46.775353 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.775156 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:46.960950 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:46.960924 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:47.059630 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:47.059476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:47.060046 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:47.059705 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:47.107335 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:47.107302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:47.284663 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:47.284579 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:47.436347 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:47.436308 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:47.816083 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:47.816053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:48.058306 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.058271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:48.058476 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.058274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:48.058476 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:48.058368 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:48.058476 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:48.058468 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:48.149137 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.149071 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:48.349177 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.349142 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:48.575986 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.575953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:48.710434 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.710401 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:48.856935 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:48.856853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:49.002754 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:49.002723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:49.058060 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:49.058032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:49.058191 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:49.058128 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:49.897136 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:49.897092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.058686 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.058649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:50.058844 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.058693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:50.058844 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.058769 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:50.058916 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.058888 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:50.064699 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.064672 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.347360 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.347324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.488063 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.488023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.606302 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.606237 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7kq6l_12480bb8-63a0-46b7-8c80-77a003039963/dns-node-resolver/0.log" Oct 30 14:06:50.629125 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.629098 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.766740 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.766703 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:50.807626 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.807597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:50.807812 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.807647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:50.807812 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.807738 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:50.807812 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.807797 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs podName:8667736d-f639-477f-9bfa-6192389bc9e7 nodeName:}" failed. No retries permitted until 2026-10-30 14:07:22.807782039 +0000 UTC m=+66.249889557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs") pod "network-metrics-daemon-bppvh" (UID: "8667736d-f639-477f-9bfa-6192389bc9e7") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 14:06:50.807955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.807739 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:50.807955 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.807858 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret podName:e02852b9-75b7-45be-9bda-657470e970e5 nodeName:}" failed. No retries permitted until 2026-10-30 14:07:22.807842189 +0000 UTC m=+66.249949711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret") pod "global-pull-secret-syncer-fjb5h" (UID: "e02852b9-75b7-45be-9bda-657470e970e5") : object "kube-system"/"original-pull-secret" not registered Oct 30 14:06:50.908269 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:50.908184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:50.908646 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.908346 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 14:06:50.908646 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.908366 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 14:06:50.908646 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.908374 2576 projected.go:196] Error preparing data for projected volume kube-api-access-jvqj5 for pod openshift-network-diagnostics/network-check-target-lbktj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:50.908646 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:50.908421 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5 podName:31822514-7734-49cc-a2b4-b9f1a99b185c nodeName:}" failed. No retries permitted until 2026-10-30 14:07:22.908407608 +0000 UTC m=+66.350515126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jvqj5" (UniqueName: "kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5") pod "network-check-target-lbktj" (UID: "31822514-7734-49cc-a2b4-b9f1a99b185c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 14:06:51.058254 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:51.058216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:51.058415 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:51.058348 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:51.161839 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:51.161746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:51.805815 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:51.805792 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvjpk_210c5840-d339-472c-bf93-70d3b994ef0b/node-ca/0.log" Oct 30 14:06:51.955563 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:51.955512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:52.058604 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:52.058522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:52.058755 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:52.058522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:52.058755 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:52.058638 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:52.058755 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:52.058741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:52.360271 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:52.360190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:52.554301 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:52.554263 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:52.755953 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:52.755918 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:53.058605 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:53.058507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:53.059056 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:53.058620 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:53.165822 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:53.165783 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:53.958192 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:53.958140 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:54.058680 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.058651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:54.059054 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:54.058754 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:54.059054 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.058818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:54.059054 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:54.058904 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:54.115348 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.115292 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:54.356313 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.356230 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:54.560200 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.560172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:54.755354 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:54.755323 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:55.058395 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:55.058326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:55.058560 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:55.058412 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:55.163148 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:55.163114 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:55.947088 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:55.947055 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:56.058413 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:56.058380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:56.058581 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:56.058420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:56.058581 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:56.058507 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:56.058689 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:56.058628 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:56.350076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:56.350003 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:56.558380 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:56.558343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:56.755330 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:56.755304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:57.063143 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.063061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:57.063275 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:57.063167 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:06:57.162075 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.162044 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:57.360245 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.360162 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:57.532907 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.532871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:57.691691 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.691644 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:57.836320 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:57.836288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:58.058112 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:58.058039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:06:58.058252 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:58.058148 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:06:58.058252 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:58.058197 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:06:58.058318 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:58.058283 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:06:58.845851 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:58.845823 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:58.993965 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:58.993921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:06:59.057889 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:06:59.057819 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:06:59.058007 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:06:59.057956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:07:00.058374 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:00.058340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:00.058854 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:00.058449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:07:00.058854 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:00.058505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:00.058854 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:00.058607 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:07:01.058654 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:01.058625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:01.059032 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:01.058728 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:07:02.058784 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:02.058754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:02.059170 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:02.058883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bppvh" podUID="8667736d-f639-477f-9bfa-6192389bc9e7" Oct 30 14:07:02.059170 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:02.058919 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:02.059170 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:02.058971 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjb5h" podUID="e02852b9-75b7-45be-9bda-657470e970e5" Oct 30 14:07:02.616622 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:02.616588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:02.810156 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:02.810116 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:02.947811 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:02.947779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:03.058172 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.058144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:03.058326 ip-10-0-130-107 kubenswrapper[2576]: E1030 14:07:03.058241 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbktj" podUID="31822514-7734-49cc-a2b4-b9f1a99b185c" Oct 30 14:07:03.780486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.780421 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeReady" Oct 30 14:07:03.780870 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.780543 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 14:07:03.847033 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.847000 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mcw8d"] Oct 30 14:07:03.848765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.848745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.852960 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.852940 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cqvhx"] Oct 30 14:07:03.854978 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.854958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.865931 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.865911 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 14:07:03.866016 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.865945 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 14:07:03.866016 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.865989 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x2qs\"" Oct 30 14:07:03.872210 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.872191 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8hflq"] Oct 30 14:07:03.873574 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.873541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:03.876468 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.876445 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mcw8d"] Oct 30 14:07:03.879200 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.879179 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqvhx"] Oct 30 14:07:03.896152 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896129 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hflq"] Oct 30 14:07:03.896399 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:03.896516 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.896516 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.896659 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.896724 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:03.896778 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28f4z\" (UniqueName: \"kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.896778 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.896873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.896873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.896873 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.897013 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.896877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmjd\" (UniqueName: \"kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.966201 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966166 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 14:07:03.966471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966330 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 14:07:03.966471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966330 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 14:07:03.966471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966449 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 14:07:03.966651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966471 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 14:07:03.966651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966490 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 14:07:03.966651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966510 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4w84p\"" Oct 30 14:07:03.966651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966524 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 14:07:03.966651 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.966537 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g7grg\"" Oct 30 14:07:03.998166 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998280 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998280 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.998280 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998280 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmjd\" (UniqueName: \"kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.998471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:03.998471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998595 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.998595 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.998595 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:03.998595 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28f4z\" (UniqueName: \"kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998790 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.998790 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:03.998790 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.999003 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.998984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:03.999077 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:03.999048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:04.002210 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.002189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:04.002301 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.002231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:04.002301 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.002251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:04.027054 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.027029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:04.027243 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.027221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmjd\" (UniqueName: \"kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:04.027373 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.027352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28f4z\" (UniqueName: \"kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:04.057900 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.057846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:04.058035 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.058025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:04.075325 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.075309 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rgz8z\"" Oct 30 14:07:04.075397 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.075359 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 14:07:04.075397 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.075357 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2dqn6\"" Oct 30 14:07:04.075462 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.075446 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 14:07:04.159792 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.159751 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:04.167841 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.167818 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:04.187363 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.187341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:04.486535 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.486502 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mcw8d"] Oct 30 14:07:04.488839 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.488766 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cqvhx"] Oct 30 14:07:04.490761 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:04.490705 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6d62da_35a7_4b2d_b528_453701e00b5f.slice/crio-619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158 WatchSource:0}: Error finding container 619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158: Status 404 returned error can't find the container with id 619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158 Oct 30 14:07:04.492723 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:04.492692 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca03e7e6_90e2_4606_8bce_151a28638ca6.slice/crio-14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071 WatchSource:0}: Error finding container 14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071: Status 404 returned error can't find the container with id 14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071 Oct 30 14:07:04.505363 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:04.505341 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hflq"] Oct 30 14:07:04.518375 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:04.518355 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb181251e_3364_46e5_9d15_63717c3e3b8a.slice/crio-e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf WatchSource:0}: Error finding container e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf: Status 404 returned error can't find the container with id e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf Oct 30 14:07:05.060685 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.060656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:05.078521 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.078492 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z4lqh\"" Oct 30 14:07:05.078711 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.078611 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 14:07:05.078711 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.078648 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 14:07:05.456694 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.456652 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqvhx" event={"ID":"ca03e7e6-90e2-4606-8bce-151a28638ca6","Type":"ContainerStarted","Data":"2ffa6a9d94fccbae1ed6060c2e352a19c87818b98987313a1940b5b0b1258285"} Oct 30 14:07:05.456890 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.456731 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqvhx" event={"ID":"ca03e7e6-90e2-4606-8bce-151a28638ca6","Type":"ContainerStarted","Data":"1fc2bc804428b2dc6be97b1d69c97cb944ca33582fbf2b282eecebeefa0691b0"} Oct 30 14:07:05.456890 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.456758 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqvhx" event={"ID":"ca03e7e6-90e2-4606-8bce-151a28638ca6","Type":"ContainerStarted","Data":"14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071"} Oct 30 14:07:05.458289 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.458231 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hflq" event={"ID":"b181251e-3364-46e5-9d15-63717c3e3b8a","Type":"ContainerStarted","Data":"e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf"} Oct 30 14:07:05.459472 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.459442 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcw8d" event={"ID":"9d6d62da-35a7-4b2d-b528-453701e00b5f","Type":"ContainerStarted","Data":"619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158"} Oct 30 14:07:05.462275 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.462248 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:05.537726 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.537693 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5"] Oct 30 14:07:05.539591 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.539570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.571580 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571086 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 14:07:05.571580 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571137 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 14:07:05.571580 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571335 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 14:07:05.571580 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571385 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 14:07:05.571580 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571506 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h2qmf\"" Oct 30 14:07:05.571920 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.571596 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 14:07:05.572500 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.572483 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5"] Oct 30 14:07:05.606535 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.606496 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:05.611230 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.611197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.611360 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.611268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.611360 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.611307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.611468 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.611381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpjh\" (UniqueName: \"kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.712576 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.712481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.712576 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.712564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpjh\" (UniqueName: \"kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.712780 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.712594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.712967 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.712943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.713321 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.713294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.715947 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.715902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.726828 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.726789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.741296 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.741245 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpjh\" (UniqueName: \"kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:05.749614 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.749565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:05.856440 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:05.856161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:06.225114 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:06.224207 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5"] Oct 30 14:07:06.464633 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:06.464594 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcw8d" event={"ID":"9d6d62da-35a7-4b2d-b528-453701e00b5f","Type":"ContainerStarted","Data":"6da68fb307b3aa590c5978374a5a5de47e5855cee88cd7a8d8bb18a41d6f7524"} Oct 30 14:07:06.464778 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:06.464661 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mcw8d" event={"ID":"9d6d62da-35a7-4b2d-b528-453701e00b5f","Type":"ContainerStarted","Data":"196d30ff83fdf2f04423bc93ba778eb5198246974ad54ae700b9e26f4991fe81"} Oct 30 14:07:06.465930 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:06.465902 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" event={"ID":"e9456444-ffe3-4bca-9b6c-3f13fbc507d0","Type":"ContainerStarted","Data":"b07c4b520e197001c0ee788a123b80747d2e9b1840a37d384571976cb3cf939f"} Oct 30 14:07:07.312265 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.312203 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:07.470785 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.470750 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cqvhx" event={"ID":"ca03e7e6-90e2-4606-8bce-151a28638ca6","Type":"ContainerStarted","Data":"b294434b6d4616322eae37e4308d6047de288ecc7017f859bf70aa5695c77c8b"} Oct 30 14:07:07.470902 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.470865 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:07.587529 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.587443 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:07.594730 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.594696 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:07.596532 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.596513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.614047 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.614030 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 14:07:07.614422 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.614404 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gq6jn\"" Oct 30 14:07:07.614594 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.614580 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 14:07:07.617290 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.617270 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 14:07:07.617290 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.617269 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 14:07:07.617429 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.617301 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 14:07:07.617483 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.617432 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 14:07:07.617483 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.617447 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 14:07:07.624938 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.624773 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:07.626333 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626400 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626400 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626476 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626525 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626653 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.626707 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.626691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.661378 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.661336 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-mcw8d" podStartSLOduration=2.916081372 podStartE2EDuration="4.661323786s" totalImagesPullingTime="1.745242414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:07.660569009 +0000 UTC m=+51.102676545" watchObservedRunningTime="2026-10-30 14:07:07.661323786 +0000 UTC m=+51.103431327" Oct 30 14:07:07.711998 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.711950 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cqvhx" podStartSLOduration=2.556340567 podStartE2EDuration="4.711935357s" totalImagesPullingTime="2.15559479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:07:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:07.711419973 +0000 UTC m=+51.153527512" watchObservedRunningTime="2026-10-30 14:07:07.711935357 +0000 UTC m=+51.154042890" Oct 30 14:07:07.728061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728182 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728182 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728182 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728332 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728193 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728332 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.728332 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.729129 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.728970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.729129 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.729134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.729349 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.729185 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.729486 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.729465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.730881 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.730856 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.730968 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.730896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.741887 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.741862 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:07.753704 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.753684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:07.907008 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:07.906922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:08.206106 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.206068 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:08.210619 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:08.210570 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf688f3a_eb23_4405_9f86_fddf7d142cad.slice/crio-eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e WatchSource:0}: Error finding container eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e: Status 404 returned error can't find the container with id eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e Oct 30 14:07:08.325499 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.325471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:08.478002 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.477918 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" event={"ID":"e9456444-ffe3-4bca-9b6c-3f13fbc507d0","Type":"ContainerStarted","Data":"d303b9e488a464aadd1164d536e38c785e9c7cf83bbad84663949af244628502"} Oct 30 14:07:08.478145 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.478009 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" event={"ID":"e9456444-ffe3-4bca-9b6c-3f13fbc507d0","Type":"ContainerStarted","Data":"e7fad04651276e65424fbfdcdd3ccc2f1e7607f28a063ac75aa07876c5b87ddc"} Oct 30 14:07:08.479234 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.479210 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d55998-fmg5l" event={"ID":"bf688f3a-eb23-4405-9f86-fddf7d142cad","Type":"ContainerStarted","Data":"eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e"} Oct 30 14:07:08.480601 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.480578 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hflq" event={"ID":"b181251e-3364-46e5-9d15-63717c3e3b8a","Type":"ContainerStarted","Data":"77fbdfafac56de23563d84a71478e94214c1caca487d134cc8cf47a9f7697b78"} Oct 30 14:07:08.524140 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.524093 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" podStartSLOduration=2.331869806 podStartE2EDuration="3.524077627s" totalImagesPullingTime="1.192207821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:08.523726956 +0000 UTC m=+51.965834497" watchObservedRunningTime="2026-10-30 14:07:08.524077627 +0000 UTC m=+51.966185164" Oct 30 14:07:08.572240 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:08.572183 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8hflq" podStartSLOduration=2.668588227 podStartE2EDuration="5.572166667s" totalImagesPullingTime="2.90357844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:08.570853031 +0000 UTC m=+52.012960571" watchObservedRunningTime="2026-10-30 14:07:08.572166667 +0000 UTC m=+52.014274208" Oct 30 14:07:10.934306 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:10.934272 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.098259 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.098168 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.171487 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.171459 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn"] Oct 30 14:07:11.174589 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.174574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.194848 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.194817 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 30 14:07:11.194974 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.194883 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lqjq7\"" Oct 30 14:07:11.208444 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.208411 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 30 14:07:11.209465 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.209446 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn"] Oct 30 14:07:11.213357 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.213340 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm"] Oct 30 14:07:11.216250 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.216236 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.241144 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.239217 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pwhkm"] Oct 30 14:07:11.241601 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.241525 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 14:07:11.241701 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.241675 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 14:07:11.241701 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.241673 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 14:07:11.241831 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.241817 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pxrnq\"" Oct 30 14:07:11.243250 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.243226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.244384 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.244366 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm"] Oct 30 14:07:11.254818 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.254794 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.257831 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.257812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.257919 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.257843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnzs\" (UniqueName: \"kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.257919 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.257862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.257919 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.257880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.258075 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl87z\" (UniqueName: \"kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.258129 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.258182 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.258272 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.258305 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.258345 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.258314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.295779 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.295754 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 14:07:11.295925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.295774 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kn7g\"" Oct 30 14:07:11.295925 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.295807 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 14:07:11.340800 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.340774 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 14:07:11.359066 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359066 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359229 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359229 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnzs\" (UniqueName: \"kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.359300 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359300 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359378 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359378 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl87z\" (UniqueName: \"kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359378 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359517 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359517 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359652 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359652 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359652 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.359794 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359794 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359794 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssgwg\" (UniqueName: \"kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.359901 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.359901 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.359901 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.359881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.360253 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.360220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.360444 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.360416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.360686 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.360665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.361999 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.361978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.362482 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.362458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.362605 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.362541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.362675 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.362639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.384196 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.384164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnzs\" (UniqueName: \"kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.384300 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.384223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl87z\" (UniqueName: \"kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.402292 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.402264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.460394 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460488 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460575 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460633 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460633 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssgwg\" (UniqueName: \"kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460741 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460741 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460741 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460741 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460927 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460927 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.460927 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.460826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.461073 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.461054 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.461127 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.461089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.461239 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.461220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.462847 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.462828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.463011 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.462993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.486729 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.486701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssgwg\" (UniqueName: \"kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.489224 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.489196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:11.492568 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.492530 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d55998-fmg5l" event={"ID":"bf688f3a-eb23-4405-9f86-fddf7d142cad","Type":"ContainerStarted","Data":"d2ba2c5523e74adb887c182e6b8e298c2d7fdc56147658cfe7a3d5a977417d2f"} Oct 30 14:07:11.531328 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.531291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:11.540714 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.540646 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-868d55998-fmg5l" podStartSLOduration=2.014658019 podStartE2EDuration="4.540625163s" totalImagesPullingTime="2.525967144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:11.539742095 +0000 UTC m=+54.981849636" watchObservedRunningTime="2026-10-30 14:07:11.540625163 +0000 UTC m=+54.982732704" Oct 30 14:07:11.550644 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.550534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.559971 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.559766 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:11.572949 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:11.572915 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371c1a73_c9ec_4d40_abf7_e9fad245c336.slice/crio-215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0 WatchSource:0}: Error finding container 215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0: Status 404 returned error can't find the container with id 215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0 Oct 30 14:07:11.695476 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.695441 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:11.798019 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.797992 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn"] Oct 30 14:07:11.800966 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:11.800938 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1146185_f6e9_4b71_aba3_95b45c7777ed.slice/crio-3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565 WatchSource:0}: Error finding container 3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565: Status 404 returned error can't find the container with id 3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565 Oct 30 14:07:11.837762 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.837738 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm"] Oct 30 14:07:11.840959 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:11.840934 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb231cb54_6891_40d2_a5a3_9833dd201dc4.slice/crio-375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c WatchSource:0}: Error finding container 375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c: Status 404 returned error can't find the container with id 375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c Oct 30 14:07:11.848756 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:11.848732 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:12.441523 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.441490 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:12.503061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.502873 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwhkm" event={"ID":"371c1a73-c9ec-4d40-abf7-e9fad245c336","Type":"ContainerStarted","Data":"a3fd19e106f597128d65920f3b0642deec20cc1762623c6fa3f9bc9b10c0b0c5"} Oct 30 14:07:12.503061 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.502947 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwhkm" event={"ID":"371c1a73-c9ec-4d40-abf7-e9fad245c336","Type":"ContainerStarted","Data":"215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0"} Oct 30 14:07:12.505689 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.505334 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" event={"ID":"b231cb54-6891-40d2-a5a3-9833dd201dc4","Type":"ContainerStarted","Data":"375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c"} Oct 30 14:07:12.508897 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.508872 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" event={"ID":"c1146185-f6e9-4b71-aba3-95b45c7777ed","Type":"ContainerStarted","Data":"4627de6ab491a7bd845ea5166d7a61cb5cc26fc5754dfff28decf3ecaf2ef7eb"} Oct 30 14:07:12.508992 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.508934 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" event={"ID":"c1146185-f6e9-4b71-aba3-95b45c7777ed","Type":"ContainerStarted","Data":"37599f22c6fafde81b7a17f93dc46031f56ea476bb35067a69a1c836a3b22a96"} Oct 30 14:07:12.508992 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.508966 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" event={"ID":"c1146185-f6e9-4b71-aba3-95b45c7777ed","Type":"ContainerStarted","Data":"3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565"} Oct 30 14:07:12.624674 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.624641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:12.706117 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.706032 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:12.710392 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.710366 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736099 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736184 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736468 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736506 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736578 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736650 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vq84m\"" Oct 30 14:07:12.736765 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.736713 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 14:07:12.743076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.743037 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 14:07:12.750337 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.750316 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 14:07:12.756998 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.756971 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 14:07:12.758535 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.758506 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:12.772020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.771994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772159 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772159 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772159 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772325 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772379 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772471 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772568 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772679 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772679 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772679 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772828 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.772828 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.772742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.776297 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.776265 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:12.873921 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.873892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.873933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.873969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.874294 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.874281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.875375 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.875122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.876223 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.876195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.876495 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.876390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.878058 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.878039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.879412 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.879383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.879734 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.879697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.879734 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.879718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.879901 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.879868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.880255 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.880232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.881030 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.881011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.881319 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.881270 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.881570 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.881521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:12.902560 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:12.902516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:13.043110 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.043088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:13.087464 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.087436 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:13.091994 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.091971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.114585 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.114226 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 14:07:13.115120 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.115097 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:13.121542 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.121413 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:13.177153 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177153 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177153 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.177446 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.177383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279128 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.278347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279649 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.279291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.279809 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.279781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.280353 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.280324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.280849 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.280827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.281147 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.281125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.281966 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.281941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:13.282418 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.282393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.283804 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.283764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.305872 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.305847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.385220 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.385177 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:13.390247 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:13.390217 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2957ec26_8942_463d_9b67_6721acdf8076.slice/crio-e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183 WatchSource:0}: Error finding container e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183: Status 404 returned error can't find the container with id e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183 Oct 30 14:07:13.440012 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.439970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:13.523307 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.523255 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183"} Oct 30 14:07:13.526531 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.526502 2576 generic.go:356] "Generic (PLEG): container finished" podID="371c1a73-c9ec-4d40-abf7-e9fad245c336" containerID="a3fd19e106f597128d65920f3b0642deec20cc1762623c6fa3f9bc9b10c0b0c5" exitCode=0 Oct 30 14:07:13.526671 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.526600 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwhkm" event={"ID":"371c1a73-c9ec-4d40-abf7-e9fad245c336","Type":"ContainerDied","Data":"a3fd19e106f597128d65920f3b0642deec20cc1762623c6fa3f9bc9b10c0b0c5"} Oct 30 14:07:13.529416 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.529366 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" event={"ID":"b231cb54-6891-40d2-a5a3-9833dd201dc4","Type":"ContainerStarted","Data":"9e1fef0670f595cedb3400815cf25816b376c878a530e96f5b228c3f6b8417bf"} Oct 30 14:07:13.529565 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.529534 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" event={"ID":"b231cb54-6891-40d2-a5a3-9833dd201dc4","Type":"ContainerStarted","Data":"a68bdbf69eaf37af8d5c6f014032ce42381e8509603bccc6af2fa7dadc48814f"} Oct 30 14:07:13.529649 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.529596 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" event={"ID":"b231cb54-6891-40d2-a5a3-9833dd201dc4","Type":"ContainerStarted","Data":"4c769d8cfc5612ecec6e7f19022a2f652baa190b3af9312c4f2bac821561966a"} Oct 30 14:07:13.531841 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.531816 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" event={"ID":"c1146185-f6e9-4b71-aba3-95b45c7777ed","Type":"ContainerStarted","Data":"ec20d572b275df659e77085ae206566d9b98bcf03659f4b52f22fcabe0510b7a"} Oct 30 14:07:13.622382 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.622216 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" podStartSLOduration=1.712331386 podStartE2EDuration="2.622198319s" totalImagesPullingTime="909.866933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:13.621580079 +0000 UTC m=+57.063687636" watchObservedRunningTime="2026-10-30 14:07:13.622198319 +0000 UTC m=+57.064305866" Oct 30 14:07:13.668688 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.668640 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" podStartSLOduration=1.49530347 podStartE2EDuration="2.668624273s" totalImagesPullingTime="1.173320803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:13.668108465 +0000 UTC m=+57.110216005" watchObservedRunningTime="2026-10-30 14:07:13.668624273 +0000 UTC m=+57.110731822" Oct 30 14:07:13.743249 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.743219 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:13.746069 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:13.746047 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49199a04_8d22_44e6_9fe1_79b348ededaf.slice/crio-4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e WatchSource:0}: Error finding container 4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e: Status 404 returned error can't find the container with id 4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e Oct 30 14:07:13.787964 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:13.787944 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:14.524965 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.524940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:14.537196 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.537171 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40"} Oct 30 14:07:14.539520 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.539501 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwhkm" event={"ID":"371c1a73-c9ec-4d40-abf7-e9fad245c336","Type":"ContainerStarted","Data":"ae8f23e91f524c708f39d5ff7873a4654cb6b46564593dee36cb31680b8cb0e7"} Oct 30 14:07:14.539625 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.539577 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwhkm" event={"ID":"371c1a73-c9ec-4d40-abf7-e9fad245c336","Type":"ContainerStarted","Data":"ff8ff5316e3465d7897cf639ff648a20153dece11cb7131a919da7e8522f8f40"} Oct 30 14:07:14.541359 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.541334 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c55b7f8c5-k2xx6" event={"ID":"49199a04-8d22-44e6-9fe1-79b348ededaf","Type":"ContainerStarted","Data":"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf"} Oct 30 14:07:14.541452 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.541376 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c55b7f8c5-k2xx6" event={"ID":"49199a04-8d22-44e6-9fe1-79b348ededaf","Type":"ContainerStarted","Data":"4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e"} Oct 30 14:07:14.641799 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.641748 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-c55b7f8c5-k2xx6" podStartSLOduration=1.6417331370000001 podStartE2EDuration="1.641733137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:14.641147296 +0000 UTC m=+58.083254835" watchObservedRunningTime="2026-10-30 14:07:14.641733137 +0000 UTC m=+58.083840676" Oct 30 14:07:14.681127 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.681086 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:14.689824 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:14.689781 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pwhkm" podStartSLOduration=2.75991563 podStartE2EDuration="3.689770258s" totalImagesPullingTime="842.479084ms" totalInitContainerRuntime="87.375544ms" isStatefulPod=true podCreationTimestamp="2026-10-30 14:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:14.688151756 +0000 UTC m=+58.130259295" watchObservedRunningTime="2026-10-30 14:07:14.689770258 +0000 UTC m=+58.131877807" Oct 30 14:07:15.326025 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.325994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:15.480449 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.480415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:15.546536 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.546507 2576 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" exitCode=0 Oct 30 14:07:15.547015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.546605 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40"} Oct 30 14:07:15.704890 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.704855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:15.804332 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.804306 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5"] Oct 30 14:07:15.807402 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.807386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.825711 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.825690 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 14:07:15.825814 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.825695 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 14:07:15.826170 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.826133 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 14:07:15.826350 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.826331 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ebqsiqrqen13p\"" Oct 30 14:07:15.826417 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.826367 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 14:07:15.826417 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.826379 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pj7c7\"" Oct 30 14:07:15.833466 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.833443 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5"] Oct 30 14:07:15.887739 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.887706 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:15.903847 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.903818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.903984 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.903847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.903984 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.903887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.903984 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.903976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.904121 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.904015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6qp\" (UniqueName: \"kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.904121 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.904051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:15.904121 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:15.904072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.004818 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.004745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.004818 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.004781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005025 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.004819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005025 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.004857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005025 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.004912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6qp\" (UniqueName: \"kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005164 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.005109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005255 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.005208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005608 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.005219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.005706 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.005642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.006086 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.006058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.007708 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.007686 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.007898 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.007882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.007948 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.007924 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.030460 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.030437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6qp\" (UniqueName: \"kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.063187 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.063152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:16.068044 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.068020 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v9s66"] Oct 30 14:07:16.072316 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.072297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.092456 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.092428 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7l6vf\"" Oct 30 14:07:16.092456 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.092444 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 14:07:16.093444 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.093413 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v9s66"] Oct 30 14:07:16.106823 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.106793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69nnt\" (UniqueName: \"kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.106943 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.106843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.118119 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.118095 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:16.208348 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.208310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69nnt\" (UniqueName: \"kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.208516 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.208366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.211000 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.210971 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:16.212528 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.212499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.241462 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.241243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69nnt\" (UniqueName: \"kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.383490 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.383149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:16.443796 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.443769 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5"] Oct 30 14:07:16.448337 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:16.448309 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23119be2_4439_4880_980b_8c1b7c2458f1.slice/crio-91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306 WatchSource:0}: Error finding container 91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306: Status 404 returned error can't find the container with id 91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306 Oct 30 14:07:16.553394 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.553354 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" event={"ID":"23119be2-4439-4880-980b-8c1b7c2458f1","Type":"ContainerStarted","Data":"91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306"} Oct 30 14:07:16.686409 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:16.686380 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-v9s66"] Oct 30 14:07:16.689413 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:16.689389 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5d2eb1_be5e_4d23_91d8_7bcfd4031baa.slice/crio-4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123 WatchSource:0}: Error finding container 4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123: Status 404 returned error can't find the container with id 4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123 Oct 30 14:07:17.483954 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.483922 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:17.575735 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.574683 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad"} Oct 30 14:07:17.575735 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.574774 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17"} Oct 30 14:07:17.577464 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.577437 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" event={"ID":"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa","Type":"ContainerStarted","Data":"4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123"} Oct 30 14:07:17.907114 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.907038 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:17.907364 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.907343 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:17.913375 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:17.913355 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:18.253102 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.253069 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:18.582159 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.582123 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" event={"ID":"23119be2-4439-4880-980b-8c1b7c2458f1","Type":"ContainerStarted","Data":"3e8378b6eb3128cb0e43e93e83e3d3f26e261be9ce57dc72aeb367517b160f2c"} Oct 30 14:07:18.583514 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.583489 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" event={"ID":"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa","Type":"ContainerStarted","Data":"7946210215b389986615ae20239b33aa094a846ad418622a3e70b7b88f312112"} Oct 30 14:07:18.583681 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.583668 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:18.587113 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.587032 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4"} Oct 30 14:07:18.587113 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.587104 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06"} Oct 30 14:07:18.587223 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.587146 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb"} Oct 30 14:07:18.589487 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.589465 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:18.591175 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.591158 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:18.630039 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.629988 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" podStartSLOduration=2.167911659 podStartE2EDuration="3.629974839s" totalImagesPullingTime="1.46206318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:18.629511183 +0000 UTC m=+62.071618740" watchObservedRunningTime="2026-10-30 14:07:18.629974839 +0000 UTC m=+62.072082378" Oct 30 14:07:18.723031 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:18.722969 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" podStartSLOduration=1.288043769 podStartE2EDuration="2.722950892s" totalImagesPullingTime="1.434907123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:18.721880242 +0000 UTC m=+62.163987784" watchObservedRunningTime="2026-10-30 14:07:18.722950892 +0000 UTC m=+62.165058433" Oct 30 14:07:19.127976 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:19.127941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:19.268797 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:19.268765 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:19.597814 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:19.597777 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerStarted","Data":"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a"} Oct 30 14:07:19.686398 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:19.685960 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.008778873 podStartE2EDuration="7.685941159s" totalImagesPullingTime="3.665864231s" totalInitContainerRuntime="11.298055ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:19.67080813 +0000 UTC m=+63.112915669" watchObservedRunningTime="2026-10-30 14:07:19.685941159 +0000 UTC m=+63.128048701" Oct 30 14:07:22.872258 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.872224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:22.872726 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.872294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:22.887974 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.887949 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 14:07:22.895377 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.895350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:22.901744 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.901723 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 14:07:22.904865 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.904841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:22.972886 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.972851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:22.985083 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.985047 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rgz8z\"" Oct 30 14:07:22.988366 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.988338 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 14:07:22.988476 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.988396 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2dqn6\"" Oct 30 14:07:22.990526 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.990503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:22.993605 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:22.993586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:23.009160 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.009124 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 14:07:23.017016 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.016984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:23.090478 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.090451 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z4lqh\"" Oct 30 14:07:23.095491 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.095471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:23.299700 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.299663 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjb5h"] Oct 30 14:07:23.307088 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:23.307060 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02852b9_75b7_45be_9bda_657470e970e5.slice/crio-6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed WatchSource:0}: Error finding container 6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed: Status 404 returned error can't find the container with id 6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed Oct 30 14:07:23.316230 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.316205 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bppvh"] Oct 30 14:07:23.320106 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:23.320073 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8667736d_f639_477f_9bfa_6192389bc9e7.slice/crio-ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c WatchSource:0}: Error finding container ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c: Status 404 returned error can't find the container with id ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c Oct 30 14:07:23.426259 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.426234 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbktj"] Oct 30 14:07:23.429904 ip-10-0-130-107 kubenswrapper[2576]: W1030 14:07:23.428466 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31822514_7734_49cc_a2b4_b9f1a99b185c.slice/crio-a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4 WatchSource:0}: Error finding container a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4: Status 404 returned error can't find the container with id a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4 Oct 30 14:07:23.440939 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.440914 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:23.441020 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.440977 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:23.445878 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.445858 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:23.613882 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.613849 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbktj" event={"ID":"31822514-7734-49cc-a2b4-b9f1a99b185c","Type":"ContainerStarted","Data":"a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4"} Oct 30 14:07:23.615257 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.615225 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bppvh" event={"ID":"8667736d-f639-477f-9bfa-6192389bc9e7","Type":"ContainerStarted","Data":"ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c"} Oct 30 14:07:23.616441 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.616419 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjb5h" event={"ID":"e02852b9-75b7-45be-9bda-657470e970e5","Type":"ContainerStarted","Data":"6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed"} Oct 30 14:07:23.620397 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.620378 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:23.700517 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:23.700448 2576 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:24.623464 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:24.623380 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bppvh" event={"ID":"8667736d-f639-477f-9bfa-6192389bc9e7","Type":"ContainerStarted","Data":"03b07b388948f2352a8d53213becff04d4e863cb544e5d70024b1f60ba8f2127"} Oct 30 14:07:24.623464 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:24.623452 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bppvh" event={"ID":"8667736d-f639-477f-9bfa-6192389bc9e7","Type":"ContainerStarted","Data":"92682c49a3f61394e56f93e25f5c507ade761837095a99cc3eb2bd9107dd0f60"} Oct 30 14:07:24.669815 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:24.669765 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bppvh" podStartSLOduration=66.67497475 podStartE2EDuration="1m7.669750774s" totalImagesPullingTime="994.776024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:24.66870566 +0000 UTC m=+68.110813197" watchObservedRunningTime="2026-10-30 14:07:24.669750774 +0000 UTC m=+68.111858314" Oct 30 14:07:24.952331 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:24.952254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.113335 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.113298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.263989 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.263867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.315960 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.315915 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:07:25.319521 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.319502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.353800 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.353770 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:07:25.397324 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397493 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397493 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397493 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397657 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397657 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397657 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.397657 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.397645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.425321 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.425258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.498791 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499015 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.498995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499254 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.499027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499387 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.499367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.499462 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.499429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.500399 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.500378 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.500492 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.500451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.501283 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.501252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.502245 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.502225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.502444 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.502422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.525685 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.525632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.583422 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.583340 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.633076 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.633038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:25.740308 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.740275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.958751 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.958697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:25.966576 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:25.966519 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:07:26.145810 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:26.145712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:26.635261 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:26.635224 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf8bbd778-xcqk5" event={"ID":"c78a06ac-a95e-427a-8a52-2bad690050b0","Type":"ContainerStarted","Data":"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169"} Oct 30 14:07:26.635754 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:26.635281 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf8bbd778-xcqk5" event={"ID":"c78a06ac-a95e-427a-8a52-2bad690050b0","Type":"ContainerStarted","Data":"8683fb0b34a49a5d2cfe97b03da66a77d3beeebe4eb940320a3565cd53a3a454"} Oct 30 14:07:26.685451 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:26.684782 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6cf8bbd778-xcqk5" podStartSLOduration=1.684762393 podStartE2EDuration="1.684762393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:26.683569323 +0000 UTC m=+70.125676888" watchObservedRunningTime="2026-10-30 14:07:26.684762393 +0000 UTC m=+70.126869933" Oct 30 14:07:27.308767 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:27.308725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:27.456191 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:27.456150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:27.642449 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:27.642365 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbktj" event={"ID":"31822514-7734-49cc-a2b4-b9f1a99b185c","Type":"ContainerStarted","Data":"3f211c80237f30bce1bb823552c2953daa8867ae597e57305a3281fb7fd06106"} Oct 30 14:07:27.642875 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:27.642583 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:27.692132 ip-10-0-130-107 kubenswrapper[2576]: I1030 14:07:27.692072 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbktj" podStartSLOduration=67.215557769 podStartE2EDuration="1m10.692057633s" totalImagesPullingTime="3.476499864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:27.691354169 +0000 UTC m=+71.133461710" watchObservedRunningTime="2026-10-30 14:07:27.692057633 +0000 UTC m=+71.134165173" Oct 30 14:07:28.583172 ip-10-0-130-107 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 14:07:28.592229 ip-10-0-130-107 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 14:07:28.592432 ip-10-0-130-107 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 14:07:28.592493 ip-10-0-130-107 systemd[1]: kubelet.service: Consumed 4.549s CPU time. Oct 30 14:07:28.612119 ip-10-0-130-107 systemd[1]: Starting Kubernetes Kubelet... Oct 30 14:07:28.690568 ip-10-0-130-107 kubenswrapper[5768]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:07:28.690568 ip-10-0-130-107 kubenswrapper[5768]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 14:07:28.690568 ip-10-0-130-107 kubenswrapper[5768]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:07:28.690568 ip-10-0-130-107 kubenswrapper[5768]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 14:07:28.692616 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692517 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.692616 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692615 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.692616 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692619 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692622 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692625 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692628 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692631 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692633 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692636 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692638 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692641 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692644 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692646 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692649 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692652 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692654 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692657 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692660 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692663 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692666 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692668 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.692709 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692670 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692673 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692675 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692678 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692680 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692683 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692693 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692696 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692699 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692701 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692704 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692706 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692710 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692713 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692716 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692719 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692721 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692724 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692727 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692729 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.693170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692740 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692744 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692746 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692749 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692751 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692754 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692757 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692759 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692762 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692765 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692767 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692770 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692772 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692775 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692778 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692780 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692783 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692787 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692790 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692793 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.693653 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692795 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692798 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692800 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692803 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692806 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692808 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692811 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692813 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692816 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692818 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692821 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692823 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692828 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692832 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692835 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692838 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692840 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692843 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692846 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.694140 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692849 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692851 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692854 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692856 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692859 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692862 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692864 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692867 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692870 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692872 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692875 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692878 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692883 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692887 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692889 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692892 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692894 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692897 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692900 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692902 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.694638 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692905 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692907 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692909 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692912 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692916 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.692918 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693730 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693738 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693741 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693744 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693747 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693750 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693753 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693756 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693759 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693762 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693765 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693768 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693770 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693773 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.695103 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693775 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693778 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693781 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693784 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693786 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693789 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693791 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693794 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693796 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693799 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693802 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693804 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693807 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693809 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693811 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693814 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693816 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693819 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693822 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.695590 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693824 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693827 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693829 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693832 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693834 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693837 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693839 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693843 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693845 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693848 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693850 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693853 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693855 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693858 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693860 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693863 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693866 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693868 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693872 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.696038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693874 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693877 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693880 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693882 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693885 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693887 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693890 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693893 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693895 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693898 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693900 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693903 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693906 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693911 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693914 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693917 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693919 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693922 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693924 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693927 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.696488 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693930 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693933 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693936 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693939 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693944 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693947 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693949 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693953 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693956 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693959 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693961 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693964 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693966 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693969 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693971 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693974 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693976 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693979 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693981 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693984 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.696986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693987 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693989 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693992 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693994 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693997 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.693999 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694002 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694005 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694007 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694011 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694015 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694018 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694021 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694023 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694522 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694527 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694532 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694535 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694537 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.697455 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694540 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694558 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694562 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694567 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694570 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694573 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694575 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694578 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694580 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694585 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694589 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694592 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694595 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694597 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694600 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694602 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694605 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694607 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694610 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.697937 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694612 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694615 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694617 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694620 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694622 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694625 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694627 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694630 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694633 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694635 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694640 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694643 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694646 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694648 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694651 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694653 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694657 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694659 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694662 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.698376 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694664 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694667 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694669 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694671 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694674 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694676 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694679 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694681 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694684 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694686 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694688 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694691 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694693 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694696 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694698 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694701 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694703 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694706 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694708 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.699101 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694710 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694713 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694715 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694725 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694729 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694731 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694735 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694737 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694740 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694742 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694745 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694748 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694750 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694753 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694755 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694758 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694760 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694763 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694765 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694773 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.699924 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694776 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694778 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694781 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694784 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694786 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694789 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694791 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694793 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694796 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694798 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694801 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694803 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694807 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694810 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694812 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694814 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694823 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694826 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694828 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694831 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.700846 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694833 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694836 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694838 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.694841 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694941 5768 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694952 5768 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694972 5768 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694977 5768 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694982 5768 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694985 5768 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694991 5768 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694996 5768 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.694999 5768 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695002 5768 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695005 5768 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695008 5768 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695011 5768 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695014 5768 flags.go:64] FLAG: --cgroup-root="" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695017 5768 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695020 5768 flags.go:64] FLAG: --client-ca-file="" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695023 5768 flags.go:64] FLAG: --cloud-provider="external" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695026 5768 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695033 5768 flags.go:64] FLAG: --cluster-domain="" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695036 5768 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 14:07:28.701613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695039 5768 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695042 5768 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695045 5768 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695049 5768 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695052 5768 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695060 5768 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695063 5768 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695066 5768 flags.go:64] FLAG: --contention-profiling="false" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695069 5768 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695072 5768 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695075 5768 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695078 5768 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695082 5768 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695085 5768 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695088 5768 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695090 5768 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695093 5768 flags.go:64] FLAG: --enable-server="true" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695096 5768 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695102 5768 flags.go:64] FLAG: --event-burst="100" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695105 5768 flags.go:64] FLAG: --event-qps="50" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695109 5768 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695112 5768 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695115 5768 flags.go:64] FLAG: --eviction-hard="" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695119 5768 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 14:07:28.702433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695122 5768 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695125 5768 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695128 5768 flags.go:64] FLAG: --eviction-soft="" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695131 5768 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695133 5768 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695136 5768 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695143 5768 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695146 5768 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695149 5768 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695151 5768 flags.go:64] FLAG: --feature-gates="" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695156 5768 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695159 5768 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695162 5768 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695165 5768 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695174 5768 flags.go:64] FLAG: --healthz-port="10248" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695177 5768 flags.go:64] FLAG: --help="false" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695180 5768 flags.go:64] FLAG: --hostname-override="ip-10-0-130-107.ec2.internal" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695183 5768 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695186 5768 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695189 5768 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695192 5768 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695195 5768 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695198 5768 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 14:07:28.703027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695201 5768 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695203 5768 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695206 5768 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695209 5768 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695212 5768 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695215 5768 flags.go:64] FLAG: --kube-reserved="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695218 5768 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695222 5768 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695225 5768 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695228 5768 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695232 5768 flags.go:64] FLAG: --lock-file="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695235 5768 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695238 5768 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695240 5768 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695246 5768 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695250 5768 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695253 5768 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695256 5768 flags.go:64] FLAG: --logging-format="text" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695259 5768 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695263 5768 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695265 5768 flags.go:64] FLAG: --manifest-url="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695268 5768 flags.go:64] FLAG: --manifest-url-header="" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695272 5768 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695275 5768 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695284 5768 flags.go:64] FLAG: --max-pods="110" Oct 30 14:07:28.703583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695287 5768 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695290 5768 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695293 5768 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695296 5768 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695299 5768 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695302 5768 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695305 5768 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695311 5768 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695314 5768 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695317 5768 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695320 5768 flags.go:64] FLAG: --pod-cidr="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695323 5768 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695326 5768 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695329 5768 flags.go:64] FLAG: --pods-per-core="0" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695332 5768 flags.go:64] FLAG: --port="10250" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695335 5768 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695338 5768 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b439ad08fadfbc5d" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695343 5768 flags.go:64] FLAG: --qos-reserved="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695346 5768 flags.go:64] FLAG: --read-only-port="10255" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695349 5768 flags.go:64] FLAG: --register-node="true" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695352 5768 flags.go:64] FLAG: --register-with-taints="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695356 5768 flags.go:64] FLAG: --registry-burst="10" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695360 5768 flags.go:64] FLAG: --registry-qps="5" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695363 5768 flags.go:64] FLAG: --reserved-cpus="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695365 5768 flags.go:64] FLAG: --reserved-memory="" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695369 5768 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 14:07:28.704164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695372 5768 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695375 5768 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695378 5768 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695380 5768 flags.go:64] FLAG: --runonce="false" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695383 5768 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695386 5768 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695390 5768 flags.go:64] FLAG: --seccomp-default="false" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695393 5768 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695395 5768 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695398 5768 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695401 5768 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695404 5768 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695407 5768 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695410 5768 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695413 5768 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695416 5768 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695419 5768 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695422 5768 flags.go:64] FLAG: --system-cgroups="" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695424 5768 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695430 5768 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695433 5768 flags.go:64] FLAG: --tls-cert-file="" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695435 5768 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695439 5768 flags.go:64] FLAG: --tls-min-version="" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695444 5768 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695447 5768 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 14:07:28.704806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695449 5768 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695452 5768 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695455 5768 flags.go:64] FLAG: --v="2" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695461 5768 flags.go:64] FLAG: --version="false" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695465 5768 flags.go:64] FLAG: --vmodule="" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695469 5768 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695472 5768 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695640 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695644 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695649 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695655 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695660 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695665 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695669 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695680 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695684 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695686 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695689 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695691 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695694 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695697 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.705388 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695699 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695702 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695704 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695707 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695710 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695712 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695715 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695717 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695720 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695725 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695727 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695730 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695732 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695734 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695738 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695741 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695743 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695747 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695751 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.705911 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695754 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695757 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695760 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695763 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695765 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695768 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695770 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695779 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695782 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695784 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695787 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695791 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695794 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695797 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695800 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695803 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695805 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695807 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695810 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.706401 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695812 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695815 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695817 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695821 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695824 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695827 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695829 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695831 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695835 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695838 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695840 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695843 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695845 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695848 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695850 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695853 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695855 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695858 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695860 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695862 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.706905 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695865 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695874 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695877 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695880 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695882 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695885 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695887 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695890 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695892 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695894 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695897 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695900 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695902 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695904 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695907 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695911 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695914 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695916 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695919 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695921 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.707481 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695925 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695927 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695930 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695932 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695935 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695937 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695939 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695942 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695944 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695947 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695949 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695952 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695955 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.695957 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.695988 5768 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696031 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.708028 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696036 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696039 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696042 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696045 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696047 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696050 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696053 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696055 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696058 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696060 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696063 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696067 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696070 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696072 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696075 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696083 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696086 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696090 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696093 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.708453 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696095 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696098 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696100 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696103 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696105 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696108 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696110 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696113 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696115 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696118 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696120 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696123 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696131 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696134 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696136 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696138 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696141 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696143 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696146 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.708938 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696149 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696151 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696154 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696156 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696159 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696164 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696167 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696169 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696172 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696174 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696177 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696180 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696183 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696186 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696190 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696193 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696195 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696198 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696201 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696203 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.709404 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696206 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696208 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696211 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696214 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696217 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696219 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696229 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696233 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696235 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696238 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696241 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696243 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696245 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696248 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696250 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696253 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696256 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696260 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696262 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.710030 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696265 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696267 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696270 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696272 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696276 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696278 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696281 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696283 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696286 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696289 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696291 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696294 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696296 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696299 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696301 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696304 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696306 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696308 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696311 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696314 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.710768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696321 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696324 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696327 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696329 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696332 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696335 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696337 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.696340 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.701663 5768 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.701685 5768 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.701711 5768 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.701719 5768 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701942 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701951 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701957 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701963 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701968 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701974 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701978 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701983 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.711232 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701988 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701992 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.701996 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702001 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702011 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702017 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702021 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702025 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702030 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702035 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702041 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702045 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702050 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702054 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702059 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702064 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702068 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702078 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702083 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702136 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.711721 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702144 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702150 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702156 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702161 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702167 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702172 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702177 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702182 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702186 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702190 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702195 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702205 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702209 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702339 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702345 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702348 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702354 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702360 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702364 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.712220 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702367 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702370 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702373 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702376 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702379 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702382 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702385 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702388 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702390 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702393 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702396 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702398 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702401 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702403 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702406 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702408 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702411 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702413 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702416 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702418 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.712692 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702421 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702423 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702426 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702429 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702431 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702435 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702438 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702442 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702444 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702447 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702450 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702453 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702455 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702458 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702462 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702466 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702468 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702471 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702474 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.713163 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702476 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702479 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702481 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702484 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702486 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702489 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702491 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702494 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702497 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702499 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702502 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702504 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702507 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702509 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702512 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702514 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702518 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702521 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702523 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.713686 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702525 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.702577 5768 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702755 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702761 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702764 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702767 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702769 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702772 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702775 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702777 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702780 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702782 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702785 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702788 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702792 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702795 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.714138 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702798 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702801 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702804 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702809 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702812 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702814 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702817 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702820 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702822 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702825 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702827 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702830 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702832 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702835 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702837 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702840 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702842 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702845 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702847 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.714517 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702850 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702853 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702855 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702858 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702860 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702868 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702871 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702874 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702876 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702879 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702881 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702884 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702886 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702889 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702892 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702894 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702898 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702901 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702903 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702906 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.714986 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702909 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702912 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702914 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702917 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702919 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702922 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702925 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702927 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702930 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702932 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702935 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702937 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702940 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702943 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702945 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702948 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702951 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702953 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702957 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702960 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.715462 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702963 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702965 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702968 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702970 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702973 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702975 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702978 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702980 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702984 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702987 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702990 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702992 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702995 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.702997 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703000 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703003 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703005 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703008 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703010 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.715983 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703013 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703015 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703018 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703021 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703023 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703027 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703031 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703035 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703038 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703041 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703044 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703046 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703049 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703052 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.703076 5768 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703109 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 14:07:28.716433 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703113 5768 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703116 5768 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703119 5768 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703122 5768 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703125 5768 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703128 5768 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703132 5768 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703134 5768 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703137 5768 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703139 5768 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703142 5768 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703145 5768 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703147 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703150 5768 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703153 5768 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703156 5768 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703158 5768 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703161 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703164 5768 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703166 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 14:07:28.716859 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703169 5768 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703172 5768 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703174 5768 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703177 5768 feature_gate.go:386] unrecognized feature gate: Example Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703179 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703182 5768 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703184 5768 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703187 5768 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703189 5768 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703192 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703195 5768 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703197 5768 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703200 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703203 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703205 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703208 5768 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703210 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703213 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703216 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 14:07:28.717358 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703219 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703221 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703224 5768 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703227 5768 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703229 5768 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703232 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703235 5768 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703240 5768 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703244 5768 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703246 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703249 5768 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703251 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703254 5768 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703256 5768 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703259 5768 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703262 5768 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703264 5768 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703266 5768 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703269 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 14:07:28.717826 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703272 5768 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703274 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703276 5768 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703279 5768 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703282 5768 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703284 5768 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703288 5768 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703291 5768 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703295 5768 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703298 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703301 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703303 5768 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703307 5768 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703310 5768 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703312 5768 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703315 5768 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703317 5768 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703320 5768 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703322 5768 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703325 5768 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 14:07:28.718328 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703332 5768 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703335 5768 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703338 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703340 5768 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703343 5768 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703345 5768 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703348 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703350 5768 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703353 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703355 5768 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703358 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703361 5768 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703363 5768 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703366 5768 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703369 5768 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703371 5768 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703373 5768 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703377 5768 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703380 5768 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 14:07:28.719170 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703383 5768 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703385 5768 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703388 5768 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703390 5768 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703393 5768 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703397 5768 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703399 5768 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:28.703402 5768 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.703458 5768 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704399 5768 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704450 5768 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704634 5768 server.go:1014] "Starting client certificate rotation" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704773 5768 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704818 5768 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 14:01:17 +0000 UTC" deadline="2028-04-06 11:09:48.374349628 +0000 UTC" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.704853 5768 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12573h2m19.669498408s" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.705079 5768 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 14:07:28.719787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.706287 5768 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 14:07:28.720306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.707638 5768 log.go:25] "Validated CRI v1 runtime API" Oct 30 14:07:28.720306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.709421 5768 log.go:25] "Validated CRI v1 image API" Oct 30 14:07:28.720306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.710167 5768 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 14:07:28.720306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.712395 5768 fs.go:135] Filesystem UUIDs: map[3f5f2f1f-e3c8-48c3-b7b1-7148b644db41:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f539c554-e07a-4021-9c6e-39c8ca6dc427:/dev/nvme0n1p3] Oct 30 14:07:28.720469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.712413 5768 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4/userdata/shm major:0 minor:83 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e/userdata/shm major:0 minor:351 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123/userdata/shm major:0 minor:379 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed/userdata/shm major:0 minor:430 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/80a35ec6769b02a0d2602c3d9b9e2b16ad5bd298eaafaa8f02329dffeeab3652/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/80a35ec6769b02a0d2602c3d9b9e2b16ad5bd298eaafaa8f02329dffeeab3652/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8683fb0b34a49a5d2cfe97b03da66a77d3beeebe4eb940320a3565cd53a3a454/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8683fb0b34a49a5d2cfe97b03da66a77d3beeebe4eb940320a3565cd53a3a454/userdata/shm major:0 minor:457 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306/userdata/shm major:0 minor:375 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4/userdata/shm major:0 minor:435 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b07c4b520e197001c0ee788a123b80747d2e9b1840a37d384571976cb3cf939f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b07c4b520e197001c0ee788a123b80747d2e9b1840a37d384571976cb3cf939f/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183/userdata/shm major:0 minor:331 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c/userdata/shm major:0 minor:431 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12480bb8-63a0-46b7-8c80-77a003039963/volumes/kubernetes.io~projected/kube-api-access-5vtz9:{mountpoint:/var/lib/kubelet/pods/12480bb8-63a0-46b7-8c80-77a003039963/volumes/kubernetes.io~projected/kube-api-access-5vtz9 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/210c5840-d339-472c-bf93-70d3b994ef0b/volumes/kubernetes.io~projected/kube-api-access-dds65:{mountpoint:/var/lib/kubelet/pods/210c5840-d339-472c-bf93-70d3b994ef0b/volumes/kubernetes.io~projected/kube-api-access-dds65 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~projected/kube-api-access-jv6qp:{mountpoint:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~projected/kube-api-access-jv6qp major:0 minor:374 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:367 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/alertmanager/9 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/config-reloader/6 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~empty-dir/config-out major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/kube-api-access-lzkxm:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/kube-api-access-lzkxm major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/tls-assets major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:321 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/config-volume major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/web-config major:0 minor:323 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~projected/kube-api-access-nllzl:{mountpoint:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~projected/kube-api-access-nllzl major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/31822514-7734-49cc-a2b4-b9f1a99b185c/volumes/kubernetes.io~projected/kube-api-access-jvqj5:{mountpoint:/var/lib/kubelet/pods/31822514-7734-49cc-a2b4-b9f1a99b185c/volumes/kubernetes.io~projected/kube-api-access-jvqj5 major:0 minor:434 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~projected/kube-api-access-ssgwg:{mountpoint:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~projected/kube-api-access-ssgwg major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~projected/kube-api-access-w8p6s:{mountpoint:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~projected/kube-api-access-w8p6s major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5e2ded23-31d3-4ca7-9c8f-b3436f857e34/volumes/kubernetes.io~projected/kube-api-access-gm8tg:{mountpoint:/var/lib/kubelet/pods/5e2ded23-31d3-4ca7-9c8f-b3436f857e34/volumes/kubernetes.io~projected/kube-api-access-gm8tg major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5fd6acf7-9d06-4623-bc36-3935d1f26ee0/volumes/kubernetes.io~projected/kube-api-access-cbdjh:{mountpoint:/var/lib/kubelet/pods/5fd6acf7-9d06-4623-bc36-3935d1f26ee0/volumes/kubernetes.io~projected/kube-api-access-cbdjh major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~projected/kube-api-access-584jq:{mountpoint:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~projected/kube-api-access-584jq major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~projected/kube-api-access-sxcjw:{mountpoint:/var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~projected/kube-api-access-sxcjw major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~secret/metrics-certs major:0 minor:425 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~projected/kube-api-access-69nnt:{mountpoint:/var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~projected/kube-api-access-69nnt major:0 minor:378 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:377 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~projected/kube-api-access-hkmjd:{mountpoint:/var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~projected/kube-api-access-hkmjd major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~projected/kube-api-access-dxr57:{mountpoint:/var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~projected/kube-api-access-dxr57 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~projected/kube-api-access-rl87z:{mountpoint:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~projected/kube-api-access-rl87z major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~projected/kube-api-access-zs2kf:{mountpoint:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~projected/kube-api-access-zs2kf major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:269 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~projected/kube-api-access-zdnzs:{mountpoint:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~projected/kube-api-access-zdnzs major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~projected/kube-api-access-b9lmb:{mountpoint:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~projected/kube-api-access-b9lmb major:0 minor:456 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:451 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~projected/kube-api-access-28f4z:{mountpoint:/var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~projected/kube-api-access-28f4z major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d776f9ca-7234-4de9-afb1-5cba943b3e33/volumes/kubernetes.io~projected/kube-api-access-wxrd7:{mountpoint:/var/lib/kubelet/pods/d776f9ca-7234-4de9-afb1-5cba943b3e33/volumes/kubernetes.io~projected/kube-api-access-wxrd7 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f/volumes/kubernetes.io~projected/kube-api-access-th48w:{mountpoint:/var/lib/kubelet/pods/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f/volumes/kubernetes.io~projected/kube-api-access-th48w major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dfa727ec-4c77-4e70-ad45-9628aff7ce9d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/dfa727ec-4c77-4e70-ad45-9628aff7ce9d/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e02852b9-75b7-45be-9bda-657470e970e5/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/e02852b9-75b7-45be-9bda-657470e970e5/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:429 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~projected/kube-api-access-bxpjh:{mountpoint:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~projected/kube-api-access-bxpjh major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:229 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/ab58417842f42973ca8fb1be81093df19ce29a50c14ff44db7b0f4988f558d4d/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/a3d63ae783fb526488c15e8f07833d72bc5ac7f19a4b1ee6b4744effa34fdb29/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/7ec6570a2391eed4b5bb19178cb99fc4da7633b022a92f4f55f4c0f9179bdaf1/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/50e71684d8bf2a2782acd27de555beb95043f87d994f9508007c1c272eb9cbfd/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/572e0ebf08b19e649559a3d31932a35891b2061d3df99f9d8ca6d22bdc8464ce/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/e3ba7bcc386868917ee85c921b0a3c0ef63362cf42118ed5e547e006064188f2/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/66397e3e57ecc8fed3506231621d6861fe3a541bd38fc0ed04d68794783da9d9/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/5574e084cf928f0b65a0f6f58869bddf3cb37510556b930ee590be603d632d70/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/3d61decac05f09930d23424a3fa7f5d88d6e779d747d16fdefa9f4f4751fbfca/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2966c01746926b64274285c8bd76326cfcffa6cfc49271e7d38d4d7cc49816f2/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/6131e9431da869611a75b63284547e9cafc68b3a0d679542072acc3ad6686643/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/8467f1b0ee0f1328b24097aae86ee34a14b96e495de037286c539b38cbdcd95b/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/05624ff160a76dea6192b7a5bb4fe216905fcefdafde965bafb92f6fb26f3175/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/d88bf0e177a5c13ad5f21b66da397b7fa2437e9cbf8c18d102288eb02ee334f5/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/5044c083d2a7d3db0add487280522326f9cbc7fff5a23fb8f54bd5088da45465/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/b470ad7c53c93d6d683c0822015aa8fba9f17a9661d643116498337b7e6f1983/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/19f2deefb8fe554ceeb9bb3eca867e89f69ad09147c91e89b4323026be70abae/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/4b9c92710308f75aeaa4424f0c6a77d38334e0682fbf4307a2dc6abc489c20bb/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-183:{mountpoint:/var/lib/containers/storage/overlay/4d706012623f488cf57f8f553c8c53c760d7937fecefebbbea14ee73212b0a71/merged major:0 minor:183 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/0db52c8db84e7ff6f4afb7bcba6eb66915d19de4c345418f31a29f4710d32f6f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/4b97fcbab29c9a103290a04b549816ccaed7c9f8122c645725421659e749f587/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/b384513929b1502d6d3b03be8d0994cf0a2c70dea8a384e2cf6591dc8fd15196/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/649fe472f81b9c39d98f0046a5f572ece4b5bfd3d107708e19aa7d0bd80591df/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/611fb4c32018dd60daf780ddde4706f77976ef136cda7b3fd6275d3061844fd2/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/d6e37b09b3cc04290baf4d3f501dc0f047a40b4e784b978465e1f32c5936f955/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/32ce7a27db491406f0262f10300d7cd7302dcfcc9d4cef10d1919112d3a4e82e/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/e9971fbbc5f3b2cb7b3a4d9917fdae08c96f48ba70f4286a20790b824dbc8c59/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/d4889c451bfc3ebb3f30b49712c9a55f92042dfe145066484b992f158085b5da/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/8a9b467b74dad8d723774d48b123cd0404da1149b0313e87ca02de81c3d32c62/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/2e9180a4784c927a38b7ae43c46ccebd060c4b4679a06c8ba202951bfd56cd36/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/b86fccc834059c1d2e88b9004b21b4c0ec74bc999d13aa4f70a183f0ee2d4925/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/f59250547a4aa61606644238727f16f5132109a622d8fc3af6a74a120b4717b6/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/d90f5504f05499ae753ba823380a5ed789a8ea5bb87f842a56f645b7b09010b1/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/58fabbed5ae4dbf97e8af936fd00447f92fa48768dfb211f359cbd7406b249b6/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/898f4f23e19ed87eee3222eaad96e62478bae3b01f5d15d60d511138a2541cc8/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/0792782c6afd6a9fb4d8a34ce75871007e6729e7e2fa4bdbe691d50009307aae/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/77ceeb2984e051d885f858126b886e3039588b995379157411baef8eb07e9b03/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/948cc344a9efbaabf57396313aa75344317905f908d5e005fc5875945b4a3ddb/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/d18332630ff6e6a635fa01c5ebda1e260a2840457431c94ff04b673a61e4be89/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/f0a00a63c78d42ad1409e131716b38921329d24683977999377113f708b99412/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/c0a0efd75b9ef6f535a97866de21e45b75a0e54dc9b478f5f4798acd9c049f1e/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/580f5a7cc92e97f49717165964ba18d5536ac0c4f38202a3701cf9bbae8e46fa/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/c3c18fdaf9d8d08157a1a5d956aa517443e0a5535db9a3af271658f5c9350e27/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/02e3bb04f4e57e83052266b66b39532246f426bf238017a1dff9b7f64d4bb9fd/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/68062d9d83e6c6d836e09116823bc3363fe86442df0318451678d42c3869472a/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/09e2303ff75fcf66f7126be3f9b2420b04764de48434acf8ab65e514fd89af63/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/aeef8faaa4bfb2f9fc4cbfc9a798bdd81d4f023c4758e06cabc86272a65072ba/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/e5318c8ad134b122be6eac7c05fcbe016d35a28ce8a89829ab7ddddd4ec4a16a/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/b8e7f8482e65412863b07a26d672e700798b296aafc9614a65b125e06a2daf23/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-381:{mountpoint:/var/lib/containers/storage/overlay/5267996334caf21e23fcca1ba3ce35b4fc6d1933da476d5fc12fc7b08a4471de/merged major:0 minor:381 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/8ad67352851bc7857a00a58d5c21c5165babc8263dcd2d4fddaf5e5dbfeb43ef/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/bcf4a3b0b69b70d5dad73e188bfdffb7af08aabe76f18ce5561a75634d4d4927/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-387:{mountpoint:/var/lib/containers/storage/overlay/7f2a70d14946172f45dee8fe93ad2f62babe139d440133ec21dfbc6fff8b016f/merged major:0 minor:387 fsType:overlay blockSize:0} overlay_0-393:{mountpoint:/var/lib/containers/storage/overlay/563bf6395078f444413298e5eea6e2c8379bf2477d356919f02c4bd1179a418a/merged major:0 minor:393 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/3a8c007f3a0925af3cb1aae225f537502f416f20524571b5fb707d65a17c97b2/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-403:{mountpoint:/var/lib/containers/storage/overlay/2b82ae3f7060c6e7741de0568eab56641efee0582e7a419a288b03130bcf7dfd/merged major:0 minor:403 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/686c88bc84c0205ecbebac5d12b5f603c12e4df5e7c1b89dc9f63a00cdb2f911/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-413:{mountpoint:/var/lib/containers/storage/overlay/7121ecaeceaa4f0e899b21d2e2a3f6f3e38dacd79a73bf5dfa373c9f67efb4dd/merged major:0 minor:413 fsType:overlay blockSize:0} overlay_0-419:{mountpoint:/var/lib/containers/storage/overlay/b9355981619a8c5a38f24a27766e99873932d905c80d68a30c0d29e0063d51f7/merged major:0 minor:419 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/bbd84151de36cc6170457372e15c6bc24537c4fd665df0ac84fedfe063e7da71/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/7c7ed0e68f597413ef575af7893bbf444ef5c2e1f2969407283e6ef671ba3891/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/29ec8c895739067c873d32d9072291d4705971d9bc511fc3cb50b653f321d29b/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/feea0a14dc44de5377a3be0563cfc329448c35f9faece03615ee49ba452f2769/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-445:{mountpoint:/var/lib/containers/storage/overlay/98cc2f501495ed4f1931d978375c11c7d43a0740b68576ebfd3d8d75c45f72a6/merged major:0 minor:445 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/bc28ed5398d999adabb89de87a3d1075949f76fd1c61de9b97d13a5eba172599/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-461:{mountpoint:/var/lib/containers/storage/overlay/66d19b496400b89d833979560f34f546a97e44dc8a521314a825ab1424c8b8e6/merged major:0 minor:461 fsType:overlay blockSize:0} overlay_0-463:{mountpoint:/var/lib/containers/storage/overlay/a68e5edd1a9795dd3586a6f3332f3ac4e498870ae166ec68af520b1eefb166af/merged major:0 minor:463 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/28b6f0904c396bf0468e4caf9cdec8e56a6ee3dd6eab5b57257f2b5f53c22b01/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/b608381e81c4aeded9071023e81ee8e543412f4e3bb1be989e0f14220d694d9f/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/9b74eab284b78cb62acb7f38c6aa93731ab701816600e7e2dbf8a755aded1112/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/11b30727536f82078b417b6abaa6abe2086a13bccfcfbe7e391c10ebbbbd732c/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/f78a47b5baf16e90728604fb137fce9278686a8f662ac7ee596df5445b59b2cb/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/85f1e496a4246b08f704d116bafbdc9f41c6e04803106228d1ddaffbec8f35fe/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/09913d859cd1799b31e75c5c0036cb014941fc8252c062f1073f89a88b1ae480/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-87:{mountpoint:/var/lib/containers/storage/overlay/ade42a3461fda3480def0cdbc0749f08b1350422332c42f2d723e187b7ff3433/merged major:0 minor:87 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/fcd93939bae060b458dc18cad133f10c1ce052769338e07e690c3fc884f8b031/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/dd639b95465bb047fe9e202e30e575c12de201c6e33a4e98f2604f66b2472085/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/2577dcd3cf55466b9928128829045ec7b84a7ea3f8597cac3baa75f78c2c0901/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 14:07:28.722238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.721787 5768 manager.go:217] Machine: {Timestamp:2026-10-30 14:07:28.721312714 +0000 UTC m=+0.060111715 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100279 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2968b492b3fd202a30eabfaa78e705 SystemUUID:ec2968b4-92b3-fd20-2a30-eabfaa78e705 BootID:cf4175e9-b39e-4cbd-b1c5-5fa51b4bc540 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/619ca14462e3e5ad1520bdf52c3a48a1cd18b43292c88bd983eefe0e836eb158/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:265 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:455 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b07c4b520e197001c0ee788a123b80747d2e9b1840a37d384571976cb3cf939f/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-403 DeviceMajor:0 DeviceMinor:403 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8683fb0b34a49a5d2cfe97b03da66a77d3beeebe4eb940320a3565cd53a3a454/userdata/shm DeviceMajor:0 DeviceMinor:457 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-387 DeviceMajor:0 DeviceMinor:387 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-413 DeviceMajor:0 DeviceMinor:413 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/80a35ec6769b02a0d2602c3d9b9e2b16ad5bd298eaafaa8f02329dffeeab3652/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dfa727ec-4c77-4e70-ad45-9628aff7ce9d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/84744ab920099d69b8f53e692dbf520834b1db2706bcd82465952c91d81fcf4a/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~projected/kube-api-access-jv6qp DeviceMajor:0 DeviceMinor:374 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~projected/kube-api-access-584jq DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:320 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e02852b9-75b7-45be-9bda-657470e970e5/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:429 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~projected/kube-api-access-dxr57 DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:321 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:367 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:277 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:288 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/91e4d07227401da6c8c97ee6c4a4df02be3b5d7f6f9a3f21eb0d9bd53ac09306/userdata/shm DeviceMajor:0 DeviceMinor:375 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-393 DeviceMajor:0 DeviceMinor:393 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-463 DeviceMajor:0 DeviceMinor:463 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9bb648c2533be3fd390c217bd75a3355304529e39ecebbd4c8e004f5f2788ece/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ca03e7e6-90e2-4606-8bce-151a28638ca6/volumes/kubernetes.io~projected/kube-api-access-28f4z DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:269 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:283 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a2e21e01b0e4f736ecddf5bcdb7bd044f86aa98a774b1ecc89fce4bc5043bbb4/userdata/shm DeviceMajor:0 DeviceMinor:435 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~projected/kube-api-access-zdnzs DeviceMajor:0 DeviceMinor:285 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e/userdata/shm DeviceMajor:0 DeviceMinor:351 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:451 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/12480bb8-63a0-46b7-8c80-77a003039963/volumes/kubernetes.io~projected/kube-api-access-5vtz9 DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f40f89acdff42ca54b0f0459597e9a157ec665559c7d6bdc498c6f93ced97643/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~projected/kube-api-access-hkmjd DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6ad86e8c859ed8ee79b35d98eb01a5e659a8ddc0661c827c114a430ef8f3f1ed/userdata/shm DeviceMajor:0 DeviceMinor:430 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/210c5840-d339-472c-bf93-70d3b994ef0b/volumes/kubernetes.io~projected/kube-api-access-dds65 DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca34cccbe348727a01377164af0ff460fed89f6ec7f9fcd11133cd4a5d91f5e5/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~projected/kube-api-access-bxpjh DeviceMajor:0 DeviceMinor:230 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:316 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-419 DeviceMajor:0 DeviceMinor:419 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~projected/kube-api-access-nllzl DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~projected/kube-api-access-ssgwg DeviceMajor:0 DeviceMinor:289 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:319 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~projected/kube-api-access-w8p6s DeviceMajor:0 DeviceMinor:348 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/375f5e6fbea042e5048ee2f94425a155af117305748f746f68f09d066c423a9c/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-445 DeviceMajor:0 DeviceMinor:445 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ac2fae0aa7b6b2e2f7d3e0a0f7db1063066d425cd2395b1f33ee177de61bcd4/userdata/shm DeviceMajor:0 DeviceMinor:83 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-183 DeviceMajor:0 DeviceMinor:183 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e1e6f3a7bd9be6f827b89862b3ce316b0ed108e03d6f27bad64727798d70eeaf/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:324 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-381 DeviceMajor:0 DeviceMinor:381 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/31822514-7734-49cc-a2b4-b9f1a99b185c/volumes/kubernetes.io~projected/kube-api-access-jvqj5 DeviceMajor:0 DeviceMinor:434 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f/volumes/kubernetes.io~projected/kube-api-access-th48w DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:284 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b231cb54-6891-40d2-a5a3-9833dd201dc4/volumes/kubernetes.io~projected/kube-api-access-rl87z DeviceMajor:0 DeviceMinor:286 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:322 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5fd6acf7-9d06-4623-bc36-3935d1f26ee0/volumes/kubernetes.io~projected/kube-api-access-cbdjh DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-87 DeviceMajor:0 DeviceMinor:87 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b181251e-3364-46e5-9d15-63717c3e3b8a/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4deee9c1344da68e7d233a1aa9ce79731591ab92206acf66a01d6c47cbd69123/userdata/shm DeviceMajor:0 DeviceMinor:379 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:321 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes/kubernetes.io~projected/kube-api-access-b9lmb DeviceMajor:0 DeviceMinor:456 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5f92ff16e2bc8ae0eaf98a9b76a06a11a4c25e9e24cebbbc519d3da76ab5c26f/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9d6d62da-35a7-4b2d-b528-453701e00b5f/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:318 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:347 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3edf3021241111cb0e4cd9be9b4d9e8096628cd650c7c28e26e5abd7ebe59565/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:323 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:372 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~projected/kube-api-access-sxcjw DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes/kubernetes.io~projected/kube-api-access-zs2kf DeviceMajor:0 DeviceMinor:270 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c1146185-f6e9-4b71-aba3-95b45c7777ed/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:282 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/215f33b3a550a053d36859df6483b57b6fe4757b6735122cba750ee2a881c3a0/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9746dc5ef71a644d33b9d0c839eaa5fd0f13f4615e6f21f92d14015d724f7d87/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f9100c354c06c7afbe67290fde25901a714db30dfe06f14615681005aafc2419/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/371c1a73-c9ec-4d40-abf7-e9fad245c336/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:287 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~projected/kube-api-access-lzkxm DeviceMajor:0 DeviceMinor:325 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~projected/kube-api-access-69nnt DeviceMajor:0 DeviceMinor:378 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/62f9d7ce-b54f-4909-8d21-53830a34f0a5/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d776f9ca-7234-4de9-afb1-5cba943b3e33/volumes/kubernetes.io~projected/kube-api-access-wxrd7 DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffb5356359b61b5c46afec831f24670a6511c899396c08c908a05dcfffa65e6c/userdata/shm DeviceMajor:0 DeviceMinor:431 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2a99d162-1cc9-4a27-8ecc-ac790e658369/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:229 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-461 DeviceMajor:0 DeviceMinor:461 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:317 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:343 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/23119be2-4439-4880-980b-8c1b7c2458f1/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:373 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e9456444-ffe3-4bca-9b6c-3f13fbc507d0/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:225 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183/userdata/shm DeviceMajor:0 DeviceMinor:331 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:377 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5e2ded23-31d3-4ca7-9c8f-b3436f857e34/volumes/kubernetes.io~projected/kube-api-access-gm8tg DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/14ae60cd0a63eb781da89ffdba57bbed93b04d47cc2e631e19975be36cdd1071/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8667736d-f639-477f-9bfa-6192389bc9e7/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:425 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:14ae60cd0a63eb7 MacAddress:2e:b3:36:73:f3:c2 Speed:10000 Mtu:8901} {Name:375f5e6fbea042e MacAddress:1a:10:29:09:7a:2f Speed:10000 Mtu:8901} {Name:3edf3021241111c MacAddress:26:5e:71:e9:68:b2 Speed:10000 Mtu:8901} {Name:4bbe46b114ddff0 MacAddress:26:d4:cd:e8:7e:35 Speed:10000 Mtu:8901} {Name:4deee9c1344da68 MacAddress:22:ec:20:18:1a:d0 Speed:10000 Mtu:8901} {Name:619ca14462e3e5a MacAddress:e2:a6:0f:f3:3f:99 Speed:10000 Mtu:8901} {Name:6ad86e8c859ed8e MacAddress:d2:53:5b:4f:e6:f5 Speed:10000 Mtu:8901} {Name:8683fb0b34a49a5 MacAddress:62:b1:28:ca:7b:1e Speed:10000 Mtu:8901} {Name:91e4d07227401da MacAddress:4a:13:41:f8:92:04 Speed:10000 Mtu:8901} {Name:a2e21e01b0e4f73 MacAddress:e6:a1:4f:f1:c6:03 Speed:10000 Mtu:8901} {Name:b07c4b520e19700 MacAddress:66:f5:ba:f6:98:8f Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f9:b9:3e:a1 Speed:0 Mtu:9001} {Name:br-int MacAddress:2e:b4:ab:ea:19:7d Speed:0 Mtu:8901} {Name:e1e6f3a7bd9be6f MacAddress:12:dc:01:82:88:42 Speed:10000 Mtu:8901} {Name:e3c0133f9a3e73e MacAddress:3a:7e:57:76:56:fb Speed:10000 Mtu:8901} {Name:eeec0117cf91199 MacAddress:8e:dc:4a:38:5b:c1 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f9:b9:3e:a1 Speed:0 Mtu:9001} {Name:ffb5356359b61b5 MacAddress:ae:48:e8:1a:dd:7e Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:22:26:f0:c3:4a:7a Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ae:bf:01:89:cb:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 14:07:28.722472 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722243 5768 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 14:07:28.722472 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722287 5768 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 14:07:28.722635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722613 5768 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 14:07:28.722761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722638 5768 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 14:07:28.722807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722767 5768 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 14:07:28.722807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722776 5768 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 14:07:28.722807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722786 5768 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 14:07:28.722807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722799 5768 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 14:07:28.722905 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.722876 5768 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 14:07:28.723036 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723026 5768 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 14:07:28.723149 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723139 5768 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 14:07:28.723190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723181 5768 kubelet.go:493] "Attempting to sync node with API server" Oct 30 14:07:28.723219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723199 5768 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 14:07:28.723219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723210 5768 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 14:07:28.723219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723218 5768 kubelet.go:405] "Adding apiserver pod source" Oct 30 14:07:28.723303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.723225 5768 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 14:07:28.724179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.724163 5768 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 14:07:28.724227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.724182 5768 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 14:07:28.724713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.724697 5768 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 14:07:28.727330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727315 5768 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 14:07:28.727330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727329 5768 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 14:07:28.727426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727419 5768 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 14:07:28.727671 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727660 5768 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 14:07:28.727711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727690 5768 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 14:07:28.727785 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727776 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727790 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727796 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727802 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727807 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727812 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 14:07:28.727817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727818 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727826 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727835 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727843 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727860 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727874 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727935 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 14:07:28.728093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.727944 5768 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 14:07:28.731652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.731637 5768 server.go:1263] "Started kubelet" Oct 30 14:07:28.731730 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.731682 5768 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 14:07:28.731792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.731740 5768 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 14:07:28.731840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.731817 5768 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 14:07:28.732174 ip-10-0-130-107 systemd[1]: Started Kubernetes Kubelet. Oct 30 14:07:28.733457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.733146 5768 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 14:07:28.736354 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.734093 5768 server.go:317] "Adding debug handlers to kubelet server" Oct 30 14:07:28.736532 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736513 5768 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736538 5768 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736600 5768 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 14:01:19 +0000 UTC" deadline="2028-05-18 07:21:43.678223808 +0000 UTC" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736635 5768 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13577h14m14.941592511s" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736674 5768 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736683 5768 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:28.736693 5768 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-107.ec2.internal\" not found" Oct 30 14:07:28.736852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.736835 5768 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 14:07:28.739439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739406 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739439 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739452 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739464 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1146185-f6e9-4b71-aba3-95b45c7777ed" volumeName="kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739475 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739485 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776f9ca-7234-4de9-afb1-5cba943b3e33" volumeName="kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739497 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfa727ec-4c77-4e70-ad45-9628aff7ce9d" volumeName="kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739510 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739523 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.739537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739534 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739562 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12480bb8-63a0-46b7-8c80-77a003039963" volumeName="kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739575 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a99d162-1cc9-4a27-8ecc-ac790e658369" volumeName="kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739588 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739598 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739612 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739624 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa" volumeName="kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739635 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739645 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776f9ca-7234-4de9-afb1-5cba943b3e33" volumeName="kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739657 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8667736d-f639-477f-9bfa-6192389bc9e7" volumeName="kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739668 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739681 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739693 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfa727ec-4c77-4e70-ad45-9628aff7ce9d" volumeName="kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739704 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="210c5840-d339-472c-bf93-70d3b994ef0b" volumeName="kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739717 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739729 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739743 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fd6acf7-9d06-4623-bc36-3935d1f26ee0" volumeName="kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739755 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9456444-ffe3-4bca-9b6c-3f13fbc507d0" volumeName="kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739766 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739782 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739794 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fd6acf7-9d06-4623-bc36-3935d1f26ee0" volumeName="kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739807 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b181251e-3364-46e5-9d15-63717c3e3b8a" volumeName="kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739820 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739832 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739844 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca03e7e6-90e2-4606-8bce-151a28638ca6" volumeName="kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739854 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9456444-ffe3-4bca-9b6c-3f13fbc507d0" volumeName="kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739865 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739877 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739888 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739903 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739914 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a99d162-1cc9-4a27-8ecc-ac790e658369" volumeName="kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739926 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739938 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739952 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ddd8ba1d-4b02-436e-a3b4-dedb4b08040f" volumeName="kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739978 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.739989 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740001 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62f9d7ce-b54f-4909-8d21-53830a34f0a5" volumeName="kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740012 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d6d62da-35a7-4b2d-b528-453701e00b5f" volumeName="kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740024 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1146185-f6e9-4b71-aba3-95b45c7777ed" volumeName="kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls" seLinuxMountContext="" Oct 30 14:07:28.740027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740037 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9456444-ffe3-4bca-9b6c-3f13fbc507d0" volumeName="kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740048 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12480bb8-63a0-46b7-8c80-77a003039963" volumeName="kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740059 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740071 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8667736d-f639-477f-9bfa-6192389bc9e7" volumeName="kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740083 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740096 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca03e7e6-90e2-4606-8bce-151a28638ca6" volumeName="kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740108 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ddd8ba1d-4b02-436e-a3b4-dedb4b08040f" volumeName="kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740121 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740141 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a99d162-1cc9-4a27-8ecc-ac790e658369" volumeName="kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740153 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740165 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740178 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740189 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740200 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5fd6acf7-9d06-4623-bc36-3935d1f26ee0" volumeName="kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740212 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b181251e-3364-46e5-9d15-63717c3e3b8a" volumeName="kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740221 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740232 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740244 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740257 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740268 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740278 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740289 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49199a04-8d22-44e6-9fe1-79b348ededaf" volumeName="kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740300 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5e2ded23-31d3-4ca7-9c8f-b3436f857e34" volumeName="kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740311 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa" volumeName="kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740324 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740335 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="371c1a73-c9ec-4d40-abf7-e9fad245c336" volumeName="kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740345 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62f9d7ce-b54f-4909-8d21-53830a34f0a5" volumeName="kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740356 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d6d62da-35a7-4b2d-b528-453701e00b5f" volumeName="kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740368 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d6d62da-35a7-4b2d-b528-453701e00b5f" volumeName="kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740379 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740391 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740402 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b231cb54-6891-40d2-a5a3-9833dd201dc4" volumeName="kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740413 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1146185-f6e9-4b71-aba3-95b45c7777ed" volumeName="kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740423 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23119be2-4439-4880-980b-8c1b7c2458f1" volumeName="kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740434 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740445 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a99d162-1cc9-4a27-8ecc-ac790e658369" volumeName="kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740457 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740468 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1146185-f6e9-4b71-aba3-95b45c7777ed" volumeName="kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740479 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740490 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740501 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c78a06ac-a95e-427a-8a52-2bad690050b0" volumeName="kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740513 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740524 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a99d162-1cc9-4a27-8ecc-ac790e658369" volumeName="kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740535 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62f9d7ce-b54f-4909-8d21-53830a34f0a5" volumeName="kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740563 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d6d62da-35a7-4b2d-b528-453701e00b5f" volumeName="kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740576 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bf688f3a-eb23-4405-9f86-fddf7d142cad" volumeName="kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740587 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca03e7e6-90e2-4606-8bce-151a28638ca6" volumeName="kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740598 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ca03e7e6-90e2-4606-8bce-151a28638ca6" volumeName="kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740613 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9456444-ffe3-4bca-9b6c-3f13fbc507d0" volumeName="kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740623 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="210c5840-d339-472c-bf93-70d3b994ef0b" volumeName="kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740634 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2957ec26-8942-463d-9b67-6721acdf8076" volumeName="kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740645 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="31822514-7734-49cc-a2b4-b9f1a99b185c" volumeName="kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740655 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776f9ca-7234-4de9-afb1-5cba943b3e33" volumeName="kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740666 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d776f9ca-7234-4de9-afb1-5cba943b3e33" volumeName="kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740676 5768 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e02852b9-75b7-45be-9bda-657470e970e5" volumeName="kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret" seLinuxMountContext="" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740687 5768 reconstruct.go:97] "Volume reconstruction finished" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.740694 5768 reconciler.go:29] "Reconciler: start to sync state" Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741217 5768 factory.go:55] Registering systemd factory Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741233 5768 factory.go:223] Registration of the systemd container factory successfully Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741453 5768 factory.go:153] Registering CRI-O factory Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741469 5768 factory.go:223] Registration of the crio container factory successfully Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741519 5768 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741538 5768 factory.go:103] Registering Raw factory Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741578 5768 manager.go:1199] Started watching for new ooms in manager Oct 30 14:07:28.742874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.741860 5768 manager.go:319] Starting recovery of all containers Oct 30 14:07:28.773330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.773284 5768 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 14:07:28.775726 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.775705 5768 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 14:07:28.775726 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.775723 5768 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 14:07:28.775926 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.775762 5768 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 14:07:28.775926 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:28.775802 5768 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 14:07:28.784678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.784657 5768 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 14:07:28.785689 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.785665 5768 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:07:28.785807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.785758 5768 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:07:28.795535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.795510 5768 generic.go:356] "Generic (PLEG): container finished" podID="371c1a73-c9ec-4d40-abf7-e9fad245c336" containerID="a3fd19e106f597128d65920f3b0642deec20cc1762623c6fa3f9bc9b10c0b0c5" exitCode=0 Oct 30 14:07:28.808765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.808738 5768 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:07:28.808934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.808914 5768 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 14:07:28.820751 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820716 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="30df964a19499bd7606caf452647545665736212480d1a6862ba30a1af831339" exitCode=0 Oct 30 14:07:28.820751 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820750 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="61209618cfc2558b116cdbccb7be1480b146d2fb29a49e8803f817b9dd1f207e" exitCode=0 Oct 30 14:07:28.820885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820758 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="f6f67038a670fc8e62866a1550530842c9af1d0498725473a14d6b878425c09b" exitCode=0 Oct 30 14:07:28.820885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820763 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="103544bb16af72d67928ffdeecaf9faaaa7fdfd4cfc574f6b3b07033868a0684" exitCode=0 Oct 30 14:07:28.820885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820769 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="a55cc1aca4eb45827ff7e84aa2eff69144470f197411913e22c524dda5523e04" exitCode=0 Oct 30 14:07:28.820885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.820773 5768 generic.go:356] "Generic (PLEG): container finished" podID="d776f9ca-7234-4de9-afb1-5cba943b3e33" containerID="674c86991b481e9a3b8366f3980e2f10d834e92baa2e8a7253be43af531d877a" exitCode=0 Oct 30 14:07:28.823984 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.823961 5768 generic.go:356] "Generic (PLEG): container finished" podID="f7ee2a181ecea111d0e2dddc4fd43090" containerID="2ffeb9509b0e014d8ac71df5fc145c79c303a31aedba1273ca35366abe812f4b" exitCode=0 Oct 30 14:07:28.827677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.827642 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" exitCode=0 Oct 30 14:07:28.856860 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.856805 5768 manager.go:324] Recovery completed Oct 30 14:07:28.875872 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:28.875844 5768 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 14:07:28.879457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879436 5768 cpu_manager.go:226] "Starting" policy="none" Oct 30 14:07:28.879457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879454 5768 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 14:07:28.879589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879474 5768 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 14:07:28.879706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879687 5768 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 14:07:28.879737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879708 5768 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 14:07:28.879737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879727 5768 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 14:07:28.879737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879733 5768 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 14:07:28.879834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879738 5768 policy_none.go:50] "Start" Oct 30 14:07:28.879834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879749 5768 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 14:07:28.879834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879761 5768 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 14:07:28.879909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879888 5768 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 14:07:28.879909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879895 5768 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 14:07:28.879909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.879900 5768 policy_none.go:44] "Start" Oct 30 14:07:28.884606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.884578 5768 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 14:07:28.887250 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.887236 5768 manager.go:341] "Starting Device Plugin manager" Oct 30 14:07:28.887870 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:28.887259 5768 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 14:07:28.887943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.887872 5768 server.go:87] "Starting device plugin registration server" Oct 30 14:07:28.888121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.888111 5768 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 14:07:28.888155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.888124 5768 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 14:07:28.888960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.888241 5768 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 14:07:28.889077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.889046 5768 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 14:07:28.889131 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.889094 5768 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 14:07:28.889131 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.889101 5768 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 14:07:28.889249 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.889165 5768 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T14:07:28.889075564Z","UUID":"3299d26b-d9bd-490d-b1fe-fdc4b392d09b","Handler":null,"Name":"","Endpoint":""} Oct 30 14:07:28.891234 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.891216 5768 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 14:07:28.891330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.891243 5768 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 14:07:28.892752 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:28.892721 5768 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 14:07:28.988779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.988743 5768 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 14:07:28.990917 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.990899 5768 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientMemory" Oct 30 14:07:28.991018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.990936 5768 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 14:07:28.991018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.990950 5768 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-107.ec2.internal" event="NodeHasSufficientPID" Oct 30 14:07:28.991018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:28.991006 5768 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.026237 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.026215 5768 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.026318 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.026276 5768 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.076563 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.076509 5768 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal"] Oct 30 14:07:29.077244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077230 5768 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.077299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077253 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerStarted","Data":"4837306d7808908f0bd1912b97996a40601ea0776ab058de267731a4185dde3c"} Oct 30 14:07:29.077332 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077296 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerDied","Data":"2ffeb9509b0e014d8ac71df5fc145c79c303a31aedba1273ca35366abe812f4b"} Oct 30 14:07:29.077332 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077311 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" event={"ID":"f7ee2a181ecea111d0e2dddc4fd43090","Type":"ContainerStarted","Data":"80a35ec6769b02a0d2602c3d9b9e2b16ad5bd298eaafaa8f02329dffeeab3652"} Oct 30 14:07:29.077393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077341 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"22a8f48498ec66db0afb340acba0d0bb","Type":"ContainerStarted","Data":"0f5e08209070d418ed80422f1be948c053ee8e1a3ad8151e91d306d151e15f9c"} Oct 30 14:07:29.077393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077356 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" event={"ID":"22a8f48498ec66db0afb340acba0d0bb","Type":"ContainerStarted","Data":"9f40a338e88e56feed619c6a54f1d3681c8fe89765d8705f4bdd00cdef0c6e5b"} Oct 30 14:07:29.077471 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.077459 5768 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.103004 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.102983 5768 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:07:29.103066 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:29.103018 5768 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.103923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.103908 5768 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:07:29.103989 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:29.103947 5768 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.187306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.187280 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.187410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.187315 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.187410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.187341 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.287874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287796 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.287986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287902 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.287986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287922 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.287986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287841 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.287986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287971 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7ee2a181ecea111d0e2dddc4fd43090-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" (UID: \"f7ee2a181ecea111d0e2dddc4fd43090\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.288117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.287970 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22a8f48498ec66db0afb340acba0d0bb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" (UID: \"22a8f48498ec66db0afb340acba0d0bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.723642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.723613 5768 apiserver.go:52] "Watching apiserver" Oct 30 14:07:29.776204 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.776171 5768 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 14:07:29.776837 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.776816 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal","openshift-insights/insights-runtime-extractor-cqvhx","openshift-network-operator/iptables-alerter-pp976","openshift-console/console-868d55998-fmg5l","openshift-dns/node-resolver-7kq6l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv","openshift-console/console-c55b7f8c5-k2xx6","openshift-cluster-node-tuning-operator/tuned-wx4xb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal","openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5","openshift-monitoring/node-exporter-pwhkm","openshift-network-diagnostics/network-check-target-lbktj","kube-system/global-pull-secret-syncer-fjb5h","openshift-console/console-6cf8bbd778-xcqk5","openshift-image-registry/node-ca-fvjpk","openshift-ovn-kubernetes/ovnkube-node-77dqh","openshift-multus/multus-cllh7","kube-system/konnectivity-agent-c558z","openshift-monitoring/alertmanager-main-0","openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm","openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5","openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn","openshift-multus/multus-additional-cni-plugins-zg69v","openshift-monitoring/monitoring-plugin-77f4f76594-v9s66","openshift-dns/dns-default-mcw8d","openshift-ingress-canary/ingress-canary-8hflq","openshift-multus/network-metrics-daemon-bppvh"] Oct 30 14:07:29.793761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.793733 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.793921 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.793787 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.793921 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.793893 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 14:07:29.793997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.793936 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.794043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794010 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.794201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794186 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.794458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794439 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.794458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794453 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 14:07:29.794458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794443 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 14:07:29.794632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794455 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.794632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794499 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 14:07:29.794632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794538 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.794755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.794721 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 14:07:29.795741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.795724 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.796050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.796038 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.796121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.796060 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.796121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.796100 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802791 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802830 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802867 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802886 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802887 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 14:07:29.802910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802900 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.803168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.802925 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.803168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.803013 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.803168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.803024 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 14:07:29.804912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.804897 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.804956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.804898 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 14:07:29.804956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.804905 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 14:07:29.805220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805201 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 14:07:29.805220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805216 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 14:07:29.805316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805244 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.805316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805253 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.805316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805269 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 14:07:29.805424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805329 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 30 14:07:29.805424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805358 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 14:07:29.805576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.805565 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 14:07:29.839909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.839892 5768 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 14:07:29.845449 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.845427 5768 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.845615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.845599 5768 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.855940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.855921 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 14:07:29.856077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.855925 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 14:07:29.856077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.855952 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 30 14:07:29.856077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.855925 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 14:07:29.856077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856036 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 30 14:07:29.856348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856186 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 14:07:29.856459 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856364 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 14:07:29.856459 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856405 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 14:07:29.856626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856577 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkz6n\"" Oct 30 14:07:29.856814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856795 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94q7c\"" Oct 30 14:07:29.856939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856919 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kvlg\"" Oct 30 14:07:29.857025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856970 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 14:07:29.857025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.856971 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x2qs\"" Oct 30 14:07:29.857213 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857200 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 14:07:29.857250 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857203 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 14:07:29.857303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857289 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 30 14:07:29.857365 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857353 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 14:07:29.857538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857514 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 14:07:29.857538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857532 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 14:07:29.857677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857532 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pj7c7\"" Oct 30 14:07:29.857677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857574 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7l6vf\"" Oct 30 14:07:29.857677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857537 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w5lxm\"" Oct 30 14:07:29.857677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857622 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 14:07:29.857850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857835 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-4w84p\"" Oct 30 14:07:29.857906 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857855 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8kn7g\"" Oct 30 14:07:29.857960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857906 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lqjq7\"" Oct 30 14:07:29.857960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857911 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 30 14:07:29.857960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857909 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g7grg\"" Oct 30 14:07:29.857960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857927 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857986 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gq6jn\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.857991 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858019 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858019 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ebqsiqrqen13p\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858038 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2dqn6\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858041 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dqvfb\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858045 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858072 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858087 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858091 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858088 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5t6gk\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858102 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-z4lqh\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858106 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858120 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rgz8z\"" Oct 30 14:07:29.858135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858142 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858146 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h2qmf\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858175 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vq84m\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858213 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mfmhk\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858268 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mlbs5\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858300 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-c5nrs\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858329 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858403 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858433 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 14:07:29.858635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.858629 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pxrnq\"" Oct 30 14:07:29.868696 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.868679 5768 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:07:29.868786 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:29.868720 5768 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-107.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.869404 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.869389 5768 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 14:07:29.869470 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:29.869428 5768 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-107.ec2.internal" Oct 30 14:07:29.890827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890800 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.890934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890834 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.890934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890858 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.890934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890875 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.891050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890922 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnzs\" (UniqueName: \"kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.891050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.890981 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl87z\" (UniqueName: \"kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.891050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891008 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.891050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891032 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891060 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891086 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891110 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891133 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891148 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-env-overrides\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891200 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-tls\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.891238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891155 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.891630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891259 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.891630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891319 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca03e7e6-90e2-4606-8bce-151a28638ca6-data-volume\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.891630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891358 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.891630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891391 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.891918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891896 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-client-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.892012 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.891439 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d6d62da-35a7-4b2d-b528-453701e00b5f-metrics-tls\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.892063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892007 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.892063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892054 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.892158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892089 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.892158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892109 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.892158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892115 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.892158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892149 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtz9\" (UniqueName: \"kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:29.892158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892148 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-script-lib\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.892367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892192 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.892367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892249 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.892367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892297 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.892496 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892383 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.892496 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892460 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.892612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892491 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.892612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892527 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.892612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892569 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllzl\" (UniqueName: \"kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.892998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892970 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.893088 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893068 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.893146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893119 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.893194 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893152 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.893239 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893203 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.893289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893237 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.893334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893308 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:29.893396 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.892967 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.893473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893422 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 30 14:07:29.893640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893430 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-tmp\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.893752 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893632 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 14:07:29.893867 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893836 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 14:07:29.893949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893729 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:29.894000 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893684 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-textfile\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.894063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893712 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 14:07:29.894063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894011 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.894063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.893674 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 14:07:29.894227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894143 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.894227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894208 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 30 14:07:29.894227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894213 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.894350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894248 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.894350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894312 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 14:07:29.894434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894404 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.894481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894448 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6qp\" (UniqueName: \"kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.894526 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894478 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.894590 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894567 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.894644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894606 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d6d62da-35a7-4b2d-b528-453701e00b5f-tmp-dir\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.894644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894620 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.894738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894667 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.894835 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894811 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.894884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894838 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-tls\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.894944 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894924 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-daemon-config\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.894994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.894974 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895036 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895144 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895169 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895219 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895220 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895273 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895289 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23119be2-4439-4880-980b-8c1b7c2458f1-audit-log\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895332 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcjw\" (UniqueName: \"kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895366 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.895438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895383 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895455 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895505 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895719 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895755 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895768 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.895923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895809 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.895949 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896007 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896044 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69nnt\" (UniqueName: \"kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896071 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896100 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896220 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896253 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896270 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 14:07:29.896296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896276 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896329 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896352 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896366 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896392 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896468 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896499 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896559 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896538 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896620 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896652 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.896702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896682 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896772 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896804 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896830 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896860 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896892 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896921 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896956 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrd7\" (UniqueName: \"kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896965 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.896987 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897008 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897017 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.897193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897052 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-584jq\" (UniqueName: \"kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897201 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8667736d-f639-477f-9bfa-6192389bc9e7-metrics-certs\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897257 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897257 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897379 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897429 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897444 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897473 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897504 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.897724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897525 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-agent-certs\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897536 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897758 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897807 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897847 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897880 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897810 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897954 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.897991 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.898126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898050 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d6d62da-35a7-4b2d-b528-453701e00b5f-config-volume\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.898492 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898210 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.898492 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898462 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.898596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898534 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.898596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898525 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.898659 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898637 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.898703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898672 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.898735 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898717 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.898768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898755 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.898798 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898779 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.898798 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898792 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.898873 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898829 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.898915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898883 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.898985 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898967 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-tuned\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.899037 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898971 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.899037 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.898968 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovn-node-metrics-cert\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.899037 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899003 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b231cb54-6891-40d2-a5a3-9833dd201dc4-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.899037 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899013 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.899154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899065 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.899154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899068 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.899154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899130 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.899154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899136 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1146185-f6e9-4b71-aba3-95b45c7777ed-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.899627 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899606 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdjh\" (UniqueName: \"kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.899690 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899652 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.899690 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899674 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.899785 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899694 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:29.899785 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899720 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.899785 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899736 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.899911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899849 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.899911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899872 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:07:29.899911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899890 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.899911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899906 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.899911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899904 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899913 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.899925 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900024 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900043 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900048 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dfa727ec-4c77-4e70-ad45-9628aff7ce9d-konnectivity-ca\") pod \"konnectivity-agent-c558z\" (UID: \"dfa727ec-4c77-4e70-ad45-9628aff7ce9d\") " pod="kube-system/konnectivity-agent-c558z" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900060 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmjd\" (UniqueName: \"kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.900124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900086 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900154 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900192 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900216 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900233 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900243 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.900366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900304 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssgwg\" (UniqueName: \"kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.900639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900431 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.900639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900504 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.900639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900594 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900638 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/210c5840-d339-472c-bf93-70d3b994ef0b-serviceca\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900661 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900690 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900705 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900717 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900724 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900761 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.900787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900773 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900792 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900826 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900858 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cni-binary-copy\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900886 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900940 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.900965 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901011 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901038 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th48w\" (UniqueName: \"kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901049 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a99d162-1cc9-4a27-8ecc-ac790e658369-ovnkube-config\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901056 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901050 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901075 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8tg\" (UniqueName: \"kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.901099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901091 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901148 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901158 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901192 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901264 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901294 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901294 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12480bb8-63a0-46b7-8c80-77a003039963-tmp-dir\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901330 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901424 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901445 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901461 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901467 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b181251e-3364-46e5-9d15-63717c3e3b8a-cert\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901476 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpjh\" (UniqueName: \"kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901484 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca03e7e6-90e2-4606-8bce-151a28638ca6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901494 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901510 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901598 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28f4z\" (UniqueName: \"kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901631 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901662 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901682 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901688 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-iptables-alerter-script\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901689 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901734 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d776f9ca-7234-4de9-afb1-5cba943b3e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.901746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901731 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901782 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901806 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901831 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901835 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1146185-f6e9-4b71-aba3-95b45c7777ed-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901858 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dds65\" (UniqueName: \"kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901865 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901889 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901911 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23119be2-4439-4880-980b-8c1b7c2458f1-secret-metrics-server-client-certs\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901919 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901933 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371c1a73-c9ec-4d40-abf7-e9fad245c336-metrics-client-ca\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901955 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.901979 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902010 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902021 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902033 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902062 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902145 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02852b9-75b7-45be-9bda-657470e970e5-original-pull-secret\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902311 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902378 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23119be2-4439-4880-980b-8c1b7c2458f1-metrics-server-audit-profiles\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.903196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.902472 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.903775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.903356 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.903775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.903364 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.912603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.912586 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnzs\" (UniqueName: \"kubernetes.io/projected/c1146185-f6e9-4b71-aba3-95b45c7777ed-kube-api-access-zdnzs\") pod \"openshift-state-metrics-7bd7489957-wr2qn\" (UID: \"c1146185-f6e9-4b71-aba3-95b45c7777ed\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-wr2qn" Oct 30 14:07:29.913293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.913273 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl87z\" (UniqueName: \"kubernetes.io/projected/b231cb54-6891-40d2-a5a3-9833dd201dc4-kube-api-access-rl87z\") pod \"kube-state-metrics-5dc8d7d89b-5cgkm\" (UID: \"b231cb54-6891-40d2-a5a3-9833dd201dc4\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-5cgkm" Oct 30 14:07:29.913666 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.913648 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtz9\" (UniqueName: \"kubernetes.io/projected/12480bb8-63a0-46b7-8c80-77a003039963-kube-api-access-5vtz9\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:29.913830 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.913816 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllzl\" (UniqueName: \"kubernetes.io/projected/2a99d162-1cc9-4a27-8ecc-ac790e658369-kube-api-access-nllzl\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:29.916716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.916701 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxr57\" (UniqueName: \"kubernetes.io/projected/b181251e-3364-46e5-9d15-63717c3e3b8a-kube-api-access-dxr57\") pod \"ingress-canary-8hflq\" (UID: \"b181251e-3364-46e5-9d15-63717c3e3b8a\") " pod="openshift-ingress-canary/ingress-canary-8hflq" Oct 30 14:07:29.916771 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.916704 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6qp\" (UniqueName: \"kubernetes.io/projected/23119be2-4439-4880-980b-8c1b7c2458f1-kube-api-access-jv6qp\") pod \"metrics-server-c5b5ccdfc-rs2s5\" (UID: \"23119be2-4439-4880-980b-8c1b7c2458f1\") " pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:29.919413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.919392 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcjw\" (UniqueName: \"kubernetes.io/projected/8667736d-f639-477f-9bfa-6192389bc9e7-kube-api-access-sxcjw\") pod \"network-metrics-daemon-bppvh\" (UID: \"8667736d-f639-477f-9bfa-6192389bc9e7\") " pod="openshift-multus/network-metrics-daemon-bppvh" Oct 30 14:07:29.919413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.919417 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrd7\" (UniqueName: \"kubernetes.io/projected/d776f9ca-7234-4de9-afb1-5cba943b3e33-kube-api-access-wxrd7\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:29.919637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.919395 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584jq\" (UniqueName: \"kubernetes.io/projected/62f9d7ce-b54f-4909-8d21-53830a34f0a5-kube-api-access-584jq\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:29.919637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.919504 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69nnt\" (UniqueName: \"kubernetes.io/projected/9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa-kube-api-access-69nnt\") pod \"monitoring-plugin-77f4f76594-v9s66\" (UID: \"9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:29.919927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.919898 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:29.920420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.920399 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdjh\" (UniqueName: \"kubernetes.io/projected/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-kube-api-access-cbdjh\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:29.920591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.920578 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"console-c55b7f8c5-k2xx6\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:29.921667 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.921645 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmjd\" (UniqueName: \"kubernetes.io/projected/9d6d62da-35a7-4b2d-b528-453701e00b5f-kube-api-access-hkmjd\") pod \"dns-default-mcw8d\" (UID: \"9d6d62da-35a7-4b2d-b528-453701e00b5f\") " pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:29.921954 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.921937 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssgwg\" (UniqueName: \"kubernetes.io/projected/371c1a73-c9ec-4d40-abf7-e9fad245c336-kube-api-access-ssgwg\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:29.922029 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.921986 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"console-868d55998-fmg5l\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:29.922199 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.922183 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"console-6cf8bbd778-xcqk5\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:29.922660 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.922646 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th48w\" (UniqueName: \"kubernetes.io/projected/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-kube-api-access-th48w\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:29.924327 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.924311 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8tg\" (UniqueName: \"kubernetes.io/projected/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kube-api-access-gm8tg\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:29.924461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.924446 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqj5\" (UniqueName: \"kubernetes.io/projected/31822514-7734-49cc-a2b4-b9f1a99b185c-kube-api-access-jvqj5\") pod \"network-check-target-lbktj\" (UID: \"31822514-7734-49cc-a2b4-b9f1a99b185c\") " pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:29.927120 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.927101 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dds65\" (UniqueName: \"kubernetes.io/projected/210c5840-d339-472c-bf93-70d3b994ef0b-kube-api-access-dds65\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:29.927329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.927311 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28f4z\" (UniqueName: \"kubernetes.io/projected/ca03e7e6-90e2-4606-8bce-151a28638ca6-kube-api-access-28f4z\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:29.927424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.927406 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"alertmanager-main-0\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:29.927771 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:29.927754 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpjh\" (UniqueName: \"kubernetes.io/projected/e9456444-ffe3-4bca-9b6c-3f13fbc507d0-kube-api-access-bxpjh\") pod \"prometheus-operator-9cd89b74c-vhtr5\" (UID: \"e9456444-ffe3-4bca-9b6c-3f13fbc507d0\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-vhtr5" Oct 30 14:07:30.002871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002797 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.002871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002829 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.002871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002845 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:30.002871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002868 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002892 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002915 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002932 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002941 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-sys-fs\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002940 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd8ba1d-4b02-436e-a3b4-dedb4b08040f-host-slash\") pod \"iptables-alerter-pp976\" (UID: \"ddd8ba1d-4b02-436e-a3b4-dedb4b08040f\") " pod="openshift-network-operator/iptables-alerter-pp976" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002970 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-conf-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002944 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003002 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.002960 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-ovn\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003038 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003045 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-multus\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003057 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003074 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.003108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003096 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003118 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-run-netns\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003121 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003143 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-sys\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003153 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003156 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-slash\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003165 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-socket-dir-parent\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003179 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003189 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-cnibin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003202 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003210 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-dbus\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003203 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-etc-kubernetes\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003223 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003238 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/210c5840-d339-472c-bf93-70d3b994ef0b-host\") pod \"node-ca-fvjpk\" (UID: \"210c5840-d339-472c-bf93-70d3b994ef0b\") " pod="openshift-image-registry/node-ca-fvjpk" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003241 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003266 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-etc-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003282 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003287 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-system-cni-dir\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003308 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003323 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysconfig\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003341 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003365 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-host\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003371 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003401 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003414 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-kubernetes\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003420 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003444 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-kubelet\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003453 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003447 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003477 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003481 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12480bb8-63a0-46b7-8c80-77a003039963-hosts-file\") pod \"node-resolver-7kq6l\" (UID: \"12480bb8-63a0-46b7-8c80-77a003039963\") " pod="openshift-dns/node-resolver-7kq6l" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003492 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003506 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003513 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-registration-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003520 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003525 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-conf\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003570 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-systemd\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003574 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-device-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003579 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-run\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003595 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003616 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003624 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-sys\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003630 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003646 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003664 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-systemd-units\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003667 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003690 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-kubelet\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003689 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-hostroot\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003706 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003721 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.003706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003737 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003757 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-root\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003773 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003780 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-run-systemd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003783 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-netd\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003802 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003818 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003827 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003851 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-var-lib-openvswitch\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003853 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003851 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-multus-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003867 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-system-cni-dir\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003878 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003898 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003913 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003930 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003913 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca03e7e6-90e2-4606-8bce-151a28638ca6-crio-socket\") pod \"insights-runtime-extractor-cqvhx\" (UID: \"ca03e7e6-90e2-4606-8bce-151a28638ca6\") " pod="openshift-insights/insights-runtime-extractor-cqvhx" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003962 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-node-log\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003966 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02852b9-75b7-45be-9bda-657470e970e5-kubelet-config\") pod \"global-pull-secret-syncer-fjb5h\" (UID: \"e02852b9-75b7-45be-9bda-657470e970e5\") " pod="kube-system/global-pull-secret-syncer-fjb5h" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003978 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-var-lib-kubelet\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.003988 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004004 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004019 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004026 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-lib-modules\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004036 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004056 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-multus-certs\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004060 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004070 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-etc-selinux\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004068 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-host-cni-bin\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004084 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004099 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004099 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-netns\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004116 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-modprobe-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004127 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004122 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-var-lib-cni-bin\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004135 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004164 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004180 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004197 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004220 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371c1a73-c9ec-4d40-abf7-e9fad245c336-node-exporter-wtmp\") pod \"node-exporter-pwhkm\" (UID: \"371c1a73-c9ec-4d40-abf7-e9fad245c336\") " pod="openshift-monitoring/node-exporter-pwhkm" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004219 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004244 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d776f9ca-7234-4de9-afb1-5cba943b3e33-cnibin\") pod \"multus-additional-cni-plugins-zg69v\" (UID: \"d776f9ca-7234-4de9-afb1-5cba943b3e33\") " pod="openshift-multus/multus-additional-cni-plugins-zg69v" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004249 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5fd6acf7-9d06-4623-bc36-3935d1f26ee0-host-run-k8s-cni-cncf-io\") pod \"multus-cllh7\" (UID: \"5fd6acf7-9d06-4623-bc36-3935d1f26ee0\") " pod="openshift-multus/multus-cllh7" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004254 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004255 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e2ded23-31d3-4ca7-9c8f-b3436f857e34-socket-dir\") pod \"aws-ebs-csi-driver-node-2cjkv\" (UID: \"5e2ded23-31d3-4ca7-9c8f-b3436f857e34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2cjkv" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004307 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62f9d7ce-b54f-4909-8d21-53830a34f0a5-etc-sysctl-d\") pod \"tuned-wx4xb\" (UID: \"62f9d7ce-b54f-4909-8d21-53830a34f0a5\") " pod="openshift-cluster-node-tuning-operator/tuned-wx4xb" Oct 30 14:07:30.005335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.004328 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a99d162-1cc9-4a27-8ecc-ac790e658369-log-socket\") pod \"ovnkube-node-77dqh\" (UID: \"2a99d162-1cc9-4a27-8ecc-ac790e658369\") " pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:30.065721 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.065695 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:30.111256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.111224 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:30.333778 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.333680 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:30.474460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.474424 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:30.834137 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:30.834098 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:31.069770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:31.069741 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:07:31.299062 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:31.299021 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:31.428669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:31.428635 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-v9s66" Oct 30 14:07:31.443060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:31.443031 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:31.467606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:31.467579 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:31.844435 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:31.844401 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:07:32.261800 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:32.261770 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mcw8d" Oct 30 14:07:34.640058 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:34.640022 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:34.823279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:34.823250 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:36.507381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:36.507353 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:36.624538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:36.624503 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:37.916797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:37.916729 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:38.064015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:38.063976 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:39.430927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:39.430898 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:39.431307 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:39.431122 5768 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 14:07:40.839002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:40.838974 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:40.842771 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:40.842749 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:07:43.177805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:43.177772 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:43.331687 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:43.331649 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:43.856466 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:43.856429 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:45.327787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:45.327741 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:45.466217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:45.466174 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:47.529703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:47.529675 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c5b5ccdfc-rs2s5" Oct 30 14:07:51.782636 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:51.782596 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:51.937887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:51.937858 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:52.256528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:52.256495 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:52.405202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:52.405167 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:07:53.092491 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092461 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092771 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="alertmanager" containerID="cri-o://a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" gracePeriod=120 Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092842 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-metric" containerID="cri-o://212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" gracePeriod=120 Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092886 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy" containerID="cri-o://3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" gracePeriod=120 Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092909 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="config-reloader" containerID="cri-o://c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" gracePeriod=120 Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092878 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-web" containerID="cri-o://67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" gracePeriod=120 Oct 30 14:07:53.093011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.092981 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="prom-label-proxy" containerID="cri-o://2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" gracePeriod=120 Oct 30 14:07:53.936310 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936279 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" exitCode=0 Oct 30 14:07:53.936310 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936306 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" exitCode=0 Oct 30 14:07:53.936310 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936317 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" exitCode=0 Oct 30 14:07:53.936577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936325 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" exitCode=0 Oct 30 14:07:53.936577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936340 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a"} Oct 30 14:07:53.936577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936401 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06"} Oct 30 14:07:53.936577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936426 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad"} Oct 30 14:07:53.936577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:53.936452 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17"} Oct 30 14:07:54.334916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.334887 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:54.403759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.403732 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.403907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.403767 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.403907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.403788 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.403907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.403811 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.403960 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404023 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404057 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404093 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404140 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404160 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:07:54.404228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404182 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404208 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:54.404630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404257 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404283 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404320 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") pod \"2957ec26-8942-463d-9b67-6721acdf8076\" (UID: \"2957ec26-8942-463d-9b67-6721acdf8076\") " Oct 30 14:07:54.404814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404672 5768 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.404814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.404694 5768 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-alertmanager-main-db\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.407207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407181 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:54.407476 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407450 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:07:54.407579 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407517 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.407645 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407621 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "kube-api-access-lzkxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:07:54.407871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407842 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.407950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.407927 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.408034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.408007 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.408123 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.408098 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:07:54.408938 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.408915 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.412935 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.412911 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.419050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.419026 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config" pod "2957ec26-8942-463d-9b67-6721acdf8076" (UID: "2957ec26-8942-463d-9b67-6721acdf8076"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505862 5768 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505891 5768 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-web-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505902 5768 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-main-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505912 5768 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-tls-assets\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505921 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzkxm\" (UniqueName: \"kubernetes.io/projected/2957ec26-8942-463d-9b67-6721acdf8076-kube-api-access-lzkxm\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505929 5768 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505938 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2957ec26-8942-463d-9b67-6721acdf8076-metrics-client-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.505940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505946 5768 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2957ec26-8942-463d-9b67-6721acdf8076-config-out\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.506283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505956 5768 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-cluster-tls-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.506283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505964 5768 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.506283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.505973 5768 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2957ec26-8942-463d-9b67-6721acdf8076-config-volume\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:54.804796 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.804746 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-868d55998-fmg5l" podUID="bf688f3a-eb23-4405-9f86-fddf7d142cad" containerName="console" containerID="cri-o://d2ba2c5523e74adb887c182e6b8e298c2d7fdc56147658cfe7a3d5a977417d2f" gracePeriod=15 Oct 30 14:07:54.941488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.941457 5768 generic.go:356] "Generic (PLEG): container finished" podID="bf688f3a-eb23-4405-9f86-fddf7d142cad" containerID="d2ba2c5523e74adb887c182e6b8e298c2d7fdc56147658cfe7a3d5a977417d2f" exitCode=0 Oct 30 14:07:54.941669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.941527 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d55998-fmg5l" event={"ID":"bf688f3a-eb23-4405-9f86-fddf7d142cad","Type":"ContainerDied","Data":"d2ba2c5523e74adb887c182e6b8e298c2d7fdc56147658cfe7a3d5a977417d2f"} Oct 30 14:07:54.944836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944809 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" exitCode=0 Oct 30 14:07:54.944836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944831 5768 generic.go:356] "Generic (PLEG): container finished" podID="2957ec26-8942-463d-9b67-6721acdf8076" containerID="67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" exitCode=0 Oct 30 14:07:54.945010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944858 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4"} Oct 30 14:07:54.945010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944884 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:54.945010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944915 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb"} Oct 30 14:07:54.945010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944943 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2957ec26-8942-463d-9b67-6721acdf8076","Type":"ContainerDied","Data":"e3c0133f9a3e73ed870904bca065a61b23d9a2ac940063a72f6a6574c6bd9183"} Oct 30 14:07:54.945010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.944976 5768 scope.go:122] "RemoveContainer" containerID="2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" Oct 30 14:07:54.954320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.954299 5768 scope.go:122] "RemoveContainer" containerID="212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" Oct 30 14:07:54.961729 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.961710 5768 scope.go:122] "RemoveContainer" containerID="3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" Oct 30 14:07:54.968717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.968693 5768 scope.go:122] "RemoveContainer" containerID="67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" Oct 30 14:07:54.976171 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.976080 5768 scope.go:122] "RemoveContainer" containerID="c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" Oct 30 14:07:54.985777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.985758 5768 scope.go:122] "RemoveContainer" containerID="a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" Oct 30 14:07:54.993566 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:54.993518 5768 scope.go:122] "RemoveContainer" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" Oct 30 14:07:55.001995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.001973 5768 scope.go:122] "RemoveContainer" containerID="2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" Oct 30 14:07:55.002406 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.002373 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a\": container with ID starting with 2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a not found: ID does not exist" containerID="2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" Oct 30 14:07:55.002472 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.002425 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a"} err="failed to get container status \"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a\": rpc error: code = NotFound desc = could not find container \"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a\": container with ID starting with 2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a not found: ID does not exist" Oct 30 14:07:55.002512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.002475 5768 scope.go:122] "RemoveContainer" containerID="212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" Oct 30 14:07:55.002772 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.002753 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4\": container with ID starting with 212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4 not found: ID does not exist" containerID="212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" Oct 30 14:07:55.002889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.002779 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4"} err="failed to get container status \"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4\": rpc error: code = NotFound desc = could not find container \"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4\": container with ID starting with 212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4 not found: ID does not exist" Oct 30 14:07:55.002889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.002797 5768 scope.go:122] "RemoveContainer" containerID="3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" Oct 30 14:07:55.003083 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.003066 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06\": container with ID starting with 3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06 not found: ID does not exist" containerID="3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" Oct 30 14:07:55.003124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003091 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06"} err="failed to get container status \"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06\": rpc error: code = NotFound desc = could not find container \"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06\": container with ID starting with 3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06 not found: ID does not exist" Oct 30 14:07:55.003124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003104 5768 scope.go:122] "RemoveContainer" containerID="67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" Oct 30 14:07:55.003366 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.003351 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb\": container with ID starting with 67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb not found: ID does not exist" containerID="67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" Oct 30 14:07:55.003412 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003369 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb"} err="failed to get container status \"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb\": rpc error: code = NotFound desc = could not find container \"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb\": container with ID starting with 67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb not found: ID does not exist" Oct 30 14:07:55.003412 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003381 5768 scope.go:122] "RemoveContainer" containerID="c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" Oct 30 14:07:55.003662 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.003641 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad\": container with ID starting with c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad not found: ID does not exist" containerID="c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" Oct 30 14:07:55.003716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003670 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad"} err="failed to get container status \"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad\": rpc error: code = NotFound desc = could not find container \"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad\": container with ID starting with c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad not found: ID does not exist" Oct 30 14:07:55.003716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.003689 5768 scope.go:122] "RemoveContainer" containerID="a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" Oct 30 14:07:55.004008 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.003987 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17\": container with ID starting with a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17 not found: ID does not exist" containerID="a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" Oct 30 14:07:55.004090 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004013 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17"} err="failed to get container status \"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17\": rpc error: code = NotFound desc = could not find container \"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17\": container with ID starting with a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17 not found: ID does not exist" Oct 30 14:07:55.004090 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004028 5768 scope.go:122] "RemoveContainer" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" Oct 30 14:07:55.004307 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:55.004293 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40\": container with ID starting with de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40 not found: ID does not exist" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" Oct 30 14:07:55.004352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004310 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40"} err="failed to get container status \"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40\": rpc error: code = NotFound desc = could not find container \"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40\": container with ID starting with de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40 not found: ID does not exist" Oct 30 14:07:55.004352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004332 5768 scope.go:122] "RemoveContainer" containerID="2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a" Oct 30 14:07:55.004598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004579 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a"} err="failed to get container status \"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a\": rpc error: code = NotFound desc = could not find container \"2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a\": container with ID starting with 2dec47e8e4f959952cf584fea1c7aa575e6c1ed781abaf512005a04b194b1b2a not found: ID does not exist" Oct 30 14:07:55.004598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004597 5768 scope.go:122] "RemoveContainer" containerID="212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4" Oct 30 14:07:55.004861 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004846 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4"} err="failed to get container status \"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4\": rpc error: code = NotFound desc = could not find container \"212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4\": container with ID starting with 212d401f8043f2256ea371a977ac939de5df07febd7baabc90c131b45015b3b4 not found: ID does not exist" Oct 30 14:07:55.004925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.004864 5768 scope.go:122] "RemoveContainer" containerID="3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06" Oct 30 14:07:55.005123 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005105 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06"} err="failed to get container status \"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06\": rpc error: code = NotFound desc = could not find container \"3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06\": container with ID starting with 3b45d1ea7517cd147feba9054079bdbbdabdf74c70261a371712b80212e1dc06 not found: ID does not exist" Oct 30 14:07:55.005192 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005124 5768 scope.go:122] "RemoveContainer" containerID="67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb" Oct 30 14:07:55.005404 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005384 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb"} err="failed to get container status \"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb\": rpc error: code = NotFound desc = could not find container \"67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb\": container with ID starting with 67d517f6f37ff3452dcdfdba73ad7cad4504cf0dca488c42fd4ee4f855edeefb not found: ID does not exist" Oct 30 14:07:55.005404 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005403 5768 scope.go:122] "RemoveContainer" containerID="c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad" Oct 30 14:07:55.005693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005670 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad"} err="failed to get container status \"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad\": rpc error: code = NotFound desc = could not find container \"c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad\": container with ID starting with c757e59bdfe467dff262735d99b1c7cb8a2ff2207a9390eb6695299b71ec75ad not found: ID does not exist" Oct 30 14:07:55.005778 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005694 5768 scope.go:122] "RemoveContainer" containerID="a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17" Oct 30 14:07:55.005934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005918 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17"} err="failed to get container status \"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17\": rpc error: code = NotFound desc = could not find container \"a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17\": container with ID starting with a5862ebbec57c744f8194c68f34a85e57dbbd3e3f55c78bb0287c32961f19f17 not found: ID does not exist" Oct 30 14:07:55.005992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.005934 5768 scope.go:122] "RemoveContainer" containerID="de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40" Oct 30 14:07:55.006161 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.006140 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40"} err="failed to get container status \"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40\": rpc error: code = NotFound desc = could not find container \"de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40\": container with ID starting with de2343818385d3d6ef45866a7fe1f6ccf5c55e1f36b02470ecf2b70ff9462f40 not found: ID does not exist" Oct 30 14:07:55.014769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.014751 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:55.027003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.026980 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:55.052351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.052327 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:55.052767 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.052749 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:55.053019 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053006 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-web" Oct 30 14:07:55.053055 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053022 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-web" Oct 30 14:07:55.053055 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053035 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-metric" Oct 30 14:07:55.053055 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053040 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-metric" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053058 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="config-reloader" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053062 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="config-reloader" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053068 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="alertmanager" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053072 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="alertmanager" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053081 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053085 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053093 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="prom-label-proxy" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053097 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="prom-label-proxy" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053104 5768 cpu_manager.go:414] "containerMap: removing container" podUID="bf688f3a-eb23-4405-9f86-fddf7d142cad" containerName="console" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053107 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf688f3a-eb23-4405-9f86-fddf7d142cad" containerName="console" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053113 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="init-config-reloader" Oct 30 14:07:55.053144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053119 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="init-config-reloader" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053158 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="config-reloader" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053166 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="alertmanager" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053171 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053177 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="prom-label-proxy" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053182 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf688f3a-eb23-4405-9f86-fddf7d142cad" containerName="console" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053187 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="init-config-reloader" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053191 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-web" Oct 30 14:07:55.053473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.053197 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2957ec26-8942-463d-9b67-6721acdf8076" containerName="kube-rbac-proxy-metric" Oct 30 14:07:55.056311 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.056292 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.071635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.071614 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 30 14:07:55.071635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.071623 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 30 14:07:55.071635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.071615 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 30 14:07:55.071635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.071623 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 30 14:07:55.072020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.072006 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vq84m\"" Oct 30 14:07:55.072075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.072038 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 30 14:07:55.072075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.072065 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 30 14:07:55.072075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.072070 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 30 14:07:55.072189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.072100 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 30 14:07:55.085333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.085306 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 30 14:07:55.090448 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.090424 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.112899 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.112959 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113033 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113065 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113092 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113121 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113174 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") pod \"bf688f3a-eb23-4405-9f86-fddf7d142cad\" (UID: \"bf688f3a-eb23-4405-9f86-fddf7d142cad\") " Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113295 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113321 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.113720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113345 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mp42\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-kube-api-access-7mp42\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113375 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.113974 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114037 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114076 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114106 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114207 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:55.114641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114495 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:07:55.114641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114538 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:55.114641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114576 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:55.114899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114804 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.114899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114845 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.115014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.114980 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.115014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115010 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.115278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115042 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.115278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115084 5768 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.115278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115100 5768 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.115278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115113 5768 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf688f3a-eb23-4405-9f86-fddf7d142cad-oauth-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.115278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.115128 5768 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf688f3a-eb23-4405-9f86-fddf7d142cad-tmp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.119146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.118997 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:55.119798 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.119765 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "kube-api-access-zs2kf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:07:55.120467 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.120439 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert" pod "bf688f3a-eb23-4405-9f86-fddf7d142cad" (UID: "bf688f3a-eb23-4405-9f86-fddf7d142cad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:55.216469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216434 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216472 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216499 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216520 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mp42\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-kube-api-access-7mp42\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216561 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216586 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216631 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216751 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216796 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216843 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216868 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216923 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216943 5768 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 14:07:55.216998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216981 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.217331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.216971 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.217331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.217077 5768 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-oauth-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.217331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.217097 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs2kf\" (UniqueName: \"kubernetes.io/projected/bf688f3a-eb23-4405-9f86-fddf7d142cad-kube-api-access-zs2kf\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.217331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.217112 5768 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf688f3a-eb23-4405-9f86-fddf7d142cad-console-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:55.218186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.218161 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.218308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.218191 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421c185c-02d5-4cee-97ff-446d8f038fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.220505 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.220445 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.220638 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.220505 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.220708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.220691 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.220765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.220691 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.220931 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.220902 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.221034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.221009 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.221096 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.221032 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/421c185c-02d5-4cee-97ff-446d8f038fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.221154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.221126 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.221583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.221541 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/421c185c-02d5-4cee-97ff-446d8f038fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.240510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.240489 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mp42\" (UniqueName: \"kubernetes.io/projected/421c185c-02d5-4cee-97ff-446d8f038fcb-kube-api-access-7mp42\") pod \"alertmanager-main-0\" (UID: \"421c185c-02d5-4cee-97ff-446d8f038fcb\") " pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.379903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.379832 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 30 14:07:55.713401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.713370 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 30 14:07:55.719095 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:55.719071 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421c185c_02d5_4cee_97ff_446d8f038fcb.slice/crio-26384a4ffcc0fe6f650e89dd637917218d071bb4b722e8e176eb8fe521ac1738 WatchSource:0}: Error finding container 26384a4ffcc0fe6f650e89dd637917218d071bb4b722e8e176eb8fe521ac1738: Status 404 returned error can't find the container with id 26384a4ffcc0fe6f650e89dd637917218d071bb4b722e8e176eb8fe521ac1738 Oct 30 14:07:55.868201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.868167 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-c55b7f8c5-k2xx6" podUID="49199a04-8d22-44e6-9fe1-79b348ededaf" containerName="console" containerID="cri-o://e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf" gracePeriod=15 Oct 30 14:07:55.950098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.950067 5768 generic.go:356] "Generic (PLEG): container finished" podID="421c185c-02d5-4cee-97ff-446d8f038fcb" containerID="37c8626cca4d66a9bf1755edc4dad8ccb2d00017882d118922549f34be9c62d1" exitCode=0 Oct 30 14:07:55.950216 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.950151 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerDied","Data":"37c8626cca4d66a9bf1755edc4dad8ccb2d00017882d118922549f34be9c62d1"} Oct 30 14:07:55.950279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.950216 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"26384a4ffcc0fe6f650e89dd637917218d071bb4b722e8e176eb8fe521ac1738"} Oct 30 14:07:55.951609 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.951583 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868d55998-fmg5l" event={"ID":"bf688f3a-eb23-4405-9f86-fddf7d142cad","Type":"ContainerDied","Data":"eeec0117cf9119971f5c90b7730294064b1e8fecdf5c4f1f9efd1330baf7177e"} Oct 30 14:07:55.951609 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.951604 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868d55998-fmg5l" Oct 30 14:07:55.951751 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:55.951647 5768 scope.go:122] "RemoveContainer" containerID="d2ba2c5523e74adb887c182e6b8e298c2d7fdc56147658cfe7a3d5a977417d2f" Oct 30 14:07:56.050925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.050901 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:56.051374 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.051351 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868d55998-fmg5l"] Oct 30 14:07:56.125014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.124992 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.225850 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.225953 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.225979 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226046 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226108 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226149 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226196 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226227 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") pod \"49199a04-8d22-44e6-9fe1-79b348ededaf\" (UID: \"49199a04-8d22-44e6-9fe1-79b348ededaf\") " Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226296 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226500 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:56.226593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226516 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:56.227217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226608 5768 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-console-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.227217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226622 5768 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-trusted-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.227217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226631 5768 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-oauth-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.227217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.226794 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:07:56.228596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.227844 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:07:56.230025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.230002 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "kube-api-access-w8p6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:07:56.230206 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.230186 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:56.230326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.230311 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert" pod "49199a04-8d22-44e6-9fe1-79b348ededaf" (UID: "49199a04-8d22-44e6-9fe1-79b348ededaf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:07:56.327261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.327236 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8p6s\" (UniqueName: \"kubernetes.io/projected/49199a04-8d22-44e6-9fe1-79b348ededaf-kube-api-access-w8p6s\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.327261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.327261 5768 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.327372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.327271 5768 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49199a04-8d22-44e6-9fe1-79b348ededaf-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.327372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.327279 5768 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49199a04-8d22-44e6-9fe1-79b348ededaf-tmp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.327372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.327287 5768 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49199a04-8d22-44e6-9fe1-79b348ededaf-console-oauth-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:07:56.781360 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.781326 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2957ec26-8942-463d-9b67-6721acdf8076" path="/var/lib/kubelet/pods/2957ec26-8942-463d-9b67-6721acdf8076/volumes" Oct 30 14:07:56.781983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.781969 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf688f3a-eb23-4405-9f86-fddf7d142cad" path="/var/lib/kubelet/pods/bf688f3a-eb23-4405-9f86-fddf7d142cad/volumes" Oct 30 14:07:56.859075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.859051 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77dqh" Oct 30 14:07:56.959164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959128 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"a8a79ef3ef819421a8cf1d19d89d30d7c7c5b1b49bc128c3d9d9fd6bb21ab26d"} Oct 30 14:07:56.959328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959200 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"b9d30d60c799965519f59945106cd7601ca98977b40f8be259388f36eefc97e9"} Oct 30 14:07:56.959328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959236 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"a3f0726168ad691bc3edbab110af14049c7626a567d47ca7cd3ce1497e0eea9d"} Oct 30 14:07:56.959328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959271 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"2c8964ca3cd502d9197a8f40d76e7867bb87790b586105446bdcd31352ea0982"} Oct 30 14:07:56.959328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959301 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"eedc9835126a1522b1ad56d85fbf3e16bb124e6580a5146337beae79aaae136f"} Oct 30 14:07:56.959537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.959339 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"421c185c-02d5-4cee-97ff-446d8f038fcb","Type":"ContainerStarted","Data":"bcd995b1b822b232ac78c64243422f2008f7a11f9b4c7fd14950f059a8c44022"} Oct 30 14:07:56.960480 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.960452 5768 generic.go:356] "Generic (PLEG): container finished" podID="49199a04-8d22-44e6-9fe1-79b348ededaf" containerID="e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf" exitCode=0 Oct 30 14:07:56.960615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.960482 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c55b7f8c5-k2xx6" Oct 30 14:07:56.960615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.960520 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c55b7f8c5-k2xx6" event={"ID":"49199a04-8d22-44e6-9fe1-79b348ededaf","Type":"ContainerDied","Data":"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf"} Oct 30 14:07:56.961118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.960957 5768 scope.go:122] "RemoveContainer" containerID="e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf" Oct 30 14:07:56.961118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.960590 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c55b7f8c5-k2xx6" event={"ID":"49199a04-8d22-44e6-9fe1-79b348ededaf","Type":"ContainerDied","Data":"4bbe46b114ddff069ae31de574bb9828d7c1922962bb628b06b38373da5f2f7e"} Oct 30 14:07:56.974860 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.974796 5768 scope.go:122] "RemoveContainer" containerID="e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf" Oct 30 14:07:56.975180 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:07:56.975155 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf\": container with ID starting with e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf not found: ID does not exist" containerID="e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf" Oct 30 14:07:56.975244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:56.975192 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf"} err="failed to get container status \"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf\": rpc error: code = NotFound desc = could not find container \"e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf\": container with ID starting with e13ba40f9b73f231b620eaff784d1e4245f500f3c5ed0ebe80ac678321c5bcaf not found: ID does not exist" Oct 30 14:07:57.025929 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.025867 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.01532205 podStartE2EDuration="2.025847445s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.525395ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:07:57.024669975 +0000 UTC m=+28.363469008" watchObservedRunningTime="2026-10-30 14:07:57.025847445 +0000 UTC m=+28.364646454" Oct 30 14:07:57.051047 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.050965 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bd744f69b-hjb9b"] Oct 30 14:07:57.051283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.051269 5768 cpu_manager.go:414] "containerMap: removing container" podUID="49199a04-8d22-44e6-9fe1-79b348ededaf" containerName="console" Oct 30 14:07:57.051340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.051284 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49199a04-8d22-44e6-9fe1-79b348ededaf" containerName="console" Oct 30 14:07:57.051392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.051361 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="49199a04-8d22-44e6-9fe1-79b348ededaf" containerName="console" Oct 30 14:07:57.055844 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.055823 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.063084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.063053 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:57.068415 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.068383 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c55b7f8c5-k2xx6"] Oct 30 14:07:57.070986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.070964 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 30 14:07:57.071098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.071008 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 30 14:07:57.071098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.071027 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 30 14:07:57.071209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.071171 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 30 14:07:57.071261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.071249 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wqk2m\"" Oct 30 14:07:57.091460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.091434 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bd744f69b-hjb9b"] Oct 30 14:07:57.134564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134515 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-metrics-client-ca\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134567 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-serving-certs-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134588 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xts9l\" (UniqueName: \"kubernetes.io/projected/dcab3e80-454e-48c4-a198-1ac9a9e9425b-kube-api-access-xts9l\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134677 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134727 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-federate-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134753 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134922 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134785 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.134922 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.134799 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.146128 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.146109 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 30 14:07:57.159222 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.159197 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 30 14:07:57.235855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.235825 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.235855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.235854 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.235882 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-metrics-client-ca\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.235993 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-serving-certs-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236044 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xts9l\" (UniqueName: \"kubernetes.io/projected/dcab3e80-454e-48c4-a198-1ac9a9e9425b-kube-api-access-xts9l\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236079 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236184 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236119 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-federate-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236234 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236182 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.236774 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236749 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-metrics-client-ca\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.237138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.236815 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-serving-certs-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.237573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.237523 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.238903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.238881 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-federate-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.238903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.238895 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-telemeter-client-tls\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.239122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.239106 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.239182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.239164 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dcab3e80-454e-48c4-a198-1ac9a9e9425b-secret-telemeter-client\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.260008 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.259983 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xts9l\" (UniqueName: \"kubernetes.io/projected/dcab3e80-454e-48c4-a198-1ac9a9e9425b-kube-api-access-xts9l\") pod \"telemeter-client-bd744f69b-hjb9b\" (UID: \"dcab3e80-454e-48c4-a198-1ac9a9e9425b\") " pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.375231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.375161 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" Oct 30 14:07:57.714085 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.714052 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bd744f69b-hjb9b"] Oct 30 14:07:57.719157 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:07:57.719132 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcab3e80_454e_48c4_a198_1ac9a9e9425b.slice/crio-5d84e22f9110b0003879d0c86b0962027227c4a32b02f6463dba017be4bca3b5 WatchSource:0}: Error finding container 5d84e22f9110b0003879d0c86b0962027227c4a32b02f6463dba017be4bca3b5: Status 404 returned error can't find the container with id 5d84e22f9110b0003879d0c86b0962027227c4a32b02f6463dba017be4bca3b5 Oct 30 14:07:57.721312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.721294 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:07:57.967483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:57.967397 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" event={"ID":"dcab3e80-454e-48c4-a198-1ac9a9e9425b","Type":"ContainerStarted","Data":"5d84e22f9110b0003879d0c86b0962027227c4a32b02f6463dba017be4bca3b5"} Oct 30 14:07:58.781298 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:58.781270 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49199a04-8d22-44e6-9fe1-79b348ededaf" path="/var/lib/kubelet/pods/49199a04-8d22-44e6-9fe1-79b348ededaf/volumes" Oct 30 14:07:59.873828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:07:59.873798 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c558z" Oct 30 14:08:00.985843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:00.985813 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" event={"ID":"dcab3e80-454e-48c4-a198-1ac9a9e9425b","Type":"ContainerStarted","Data":"f33ee6aa5cb931aeb9f59cbd2e5aac89a967ae69a4ad2abba3bc2ecfee5afdd4"} Oct 30 14:08:00.986242 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:00.985867 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" event={"ID":"dcab3e80-454e-48c4-a198-1ac9a9e9425b","Type":"ContainerStarted","Data":"bfea2222247e5bc5fbb13701cc4d87d14349a01818c4b3740c3ed4c404db16ef"} Oct 30 14:08:00.986242 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:00.985889 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" event={"ID":"dcab3e80-454e-48c4-a198-1ac9a9e9425b","Type":"ContainerStarted","Data":"6df8c0d6f9e54452a78449bbfeeb9c139c55a9898795698b3e57b8306aa8c5e6"} Oct 30 14:08:01.057813 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.057754 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bd744f69b-hjb9b" podStartSLOduration=1.8234067760000001 podStartE2EDuration="4.057740549s" totalImagesPullingTime="2.234333773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:08:01.057074137 +0000 UTC m=+32.395873147" watchObservedRunningTime="2026-10-30 14:08:01.057740549 +0000 UTC m=+32.396539553" Oct 30 14:08:01.071905 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.071873 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbktj" Oct 30 14:08:01.262044 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.261955 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:08:01.283342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.283311 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.289265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.289242 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:08:01.372347 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372309 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372347 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372353 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372372 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqq4\" (UniqueName: \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372478 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372573 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372631 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372677 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.372720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.372694 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.430736 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.430685 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:08:01.473305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473274 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473308 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473341 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473360 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473383 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqq4\" (UniqueName: \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473414 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473463 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473485 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.473975 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.473952 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.474198 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.474175 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.474401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.474378 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.474493 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.474475 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.474707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.474686 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.475981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.475962 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.476169 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.476153 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.497354 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.497330 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqq4\" (UniqueName: \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\") pod \"console-79cf45cb5d-gphj5\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.586979 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.586891 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:08:01.610689 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.610661 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:01.732198 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.732168 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:08:01.844377 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:08:01.844297 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:08:01.937233 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.937201 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:08:01.942971 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:08:01.942948 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4feda7_d8a8_4014_acaa_a0c922d2220f.slice/crio-d787aa15139602842abe8603461d3461ce4cb23491190300fddb8de6be3d9cc5 WatchSource:0}: Error finding container d787aa15139602842abe8603461d3461ce4cb23491190300fddb8de6be3d9cc5: Status 404 returned error can't find the container with id d787aa15139602842abe8603461d3461ce4cb23491190300fddb8de6be3d9cc5 Oct 30 14:08:01.991181 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:01.991154 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf45cb5d-gphj5" event={"ID":"3f4feda7-d8a8-4014-acaa-a0c922d2220f","Type":"ContainerStarted","Data":"d787aa15139602842abe8603461d3461ce4cb23491190300fddb8de6be3d9cc5"} Oct 30 14:08:02.996268 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:02.996237 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf45cb5d-gphj5" event={"ID":"3f4feda7-d8a8-4014-acaa-a0c922d2220f","Type":"ContainerStarted","Data":"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0"} Oct 30 14:08:03.052101 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:03.052054 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-79cf45cb5d-gphj5" podStartSLOduration=2.052039909 podStartE2EDuration="2.052039909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:08:03.039882992 +0000 UTC m=+34.378682022" watchObservedRunningTime="2026-10-30 14:08:03.052039909 +0000 UTC m=+34.390838919" Oct 30 14:08:11.611294 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:11.611253 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:11.611294 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:11.611304 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:11.615988 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:11.615965 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:12.031849 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:12.031820 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:08:12.105584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:12.105539 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:08:31.844666 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:08:31.844631 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:08:34.767444 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:34.767410 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:08:37.126038 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.126000 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6cf8bbd778-xcqk5" podUID="c78a06ac-a95e-427a-8a52-2bad690050b0" containerName="console" containerID="cri-o://a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169" gracePeriod=15 Oct 30 14:08:37.367118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.367095 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:08:37.473494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473457 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473495 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473526 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473568 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473593 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473612 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473638 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.473779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473664 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") pod \"c78a06ac-a95e-427a-8a52-2bad690050b0\" (UID: \"c78a06ac-a95e-427a-8a52-2bad690050b0\") " Oct 30 14:08:37.474069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473949 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:08:37.474069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.473956 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:08:37.474212 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.474181 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:08:37.474284 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.474209 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:08:37.474338 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.474276 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:08:37.475972 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.475950 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:08:37.476060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.476040 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:08:37.476060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.476043 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb" pod "c78a06ac-a95e-427a-8a52-2bad690050b0" (UID: "c78a06ac-a95e-427a-8a52-2bad690050b0"). InnerVolumeSpecName "kube-api-access-b9lmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:08:37.574293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574259 5768 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-console-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574283 5768 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-oauth-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574294 5768 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-trusted-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574304 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9lmb\" (UniqueName: \"kubernetes.io/projected/c78a06ac-a95e-427a-8a52-2bad690050b0-kube-api-access-b9lmb\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574536 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574312 5768 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c78a06ac-a95e-427a-8a52-2bad690050b0-tmp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574536 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574321 5768 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-oauth-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574536 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574330 5768 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c78a06ac-a95e-427a-8a52-2bad690050b0-console-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:37.574536 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:37.574340 5768 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c78a06ac-a95e-427a-8a52-2bad690050b0-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:08:38.123060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.123026 5768 generic.go:356] "Generic (PLEG): container finished" podID="c78a06ac-a95e-427a-8a52-2bad690050b0" containerID="a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169" exitCode=0 Oct 30 14:08:38.123236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.123079 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf8bbd778-xcqk5" Oct 30 14:08:38.123236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.123111 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf8bbd778-xcqk5" event={"ID":"c78a06ac-a95e-427a-8a52-2bad690050b0","Type":"ContainerDied","Data":"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169"} Oct 30 14:08:38.123236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.123168 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf8bbd778-xcqk5" event={"ID":"c78a06ac-a95e-427a-8a52-2bad690050b0","Type":"ContainerDied","Data":"8683fb0b34a49a5d2cfe97b03da66a77d3beeebe4eb940320a3565cd53a3a454"} Oct 30 14:08:38.123236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.123189 5768 scope.go:122] "RemoveContainer" containerID="a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169" Oct 30 14:08:38.132027 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.131845 5768 scope.go:122] "RemoveContainer" containerID="a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169" Oct 30 14:08:38.132248 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:08:38.132130 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169\": container with ID starting with a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169 not found: ID does not exist" containerID="a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169" Oct 30 14:08:38.132248 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.132153 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169"} err="failed to get container status \"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169\": rpc error: code = NotFound desc = could not find container \"a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169\": container with ID starting with a27886321ced55f77d39c270c6acd906fd10e1b8a5e85d30408c537e7885a169 not found: ID does not exist" Oct 30 14:08:38.174906 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.174881 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:08:38.186581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.186535 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf8bbd778-xcqk5"] Oct 30 14:08:38.781263 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:38.781233 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c78a06ac-a95e-427a-8a52-2bad690050b0" path="/var/lib/kubelet/pods/c78a06ac-a95e-427a-8a52-2bad690050b0/volumes" Oct 30 14:08:42.094749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:08:42.094707 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:01.844088 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:09:01.844046 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:09:07.755799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:07.755765 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:07.903117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:07.903076 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:09.535245 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.535169 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c7dfcdb7-r56ck"] Oct 30 14:09:09.535621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.535485 5768 cpu_manager.go:414] "containerMap: removing container" podUID="c78a06ac-a95e-427a-8a52-2bad690050b0" containerName="console" Oct 30 14:09:09.535621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.535496 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c78a06ac-a95e-427a-8a52-2bad690050b0" containerName="console" Oct 30 14:09:09.535621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.535543 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="c78a06ac-a95e-427a-8a52-2bad690050b0" containerName="console" Oct 30 14:09:09.537301 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.537283 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.567283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.567263 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7dfcdb7-r56ck"] Oct 30 14:09:09.621714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621684 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-service-ca\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.621840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621725 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.621840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621800 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.621910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621847 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4527\" (UniqueName: \"kubernetes.io/projected/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-kube-api-access-z4527\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.621910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621865 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-tmp\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.621977 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621935 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-oauth-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.622009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.621986 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-trusted-ca-bundle\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.622009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.622002 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-oauth-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722476 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-trusted-ca-bundle\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722509 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-oauth-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722541 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-service-ca\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722599 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722645 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722701 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4527\" (UniqueName: \"kubernetes.io/projected/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-kube-api-access-z4527\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.722724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722723 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-tmp\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723004 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.722759 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-oauth-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.723092 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-tmp\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723408 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.723386 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-service-ca\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723506 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.723488 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-oauth-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.723622 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-trusted-ca-bundle\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.723688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.723657 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.725291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.725271 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-serving-cert\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.725387 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.725297 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-console-oauth-config\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.728115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.728094 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:09.746949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.746920 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4527\" (UniqueName: \"kubernetes.io/projected/3566f4ef-8f6f-453d-a776-ac5332c2c2ff-kube-api-access-z4527\") pod \"console-6c7dfcdb7-r56ck\" (UID: \"3566f4ef-8f6f-453d-a776-ac5332c2c2ff\") " pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.847280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.847198 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:09.873052 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:09.872986 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:10.027408 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:10.027372 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:10.157577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:10.157492 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7dfcdb7-r56ck"] Oct 30 14:09:10.162862 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:09:10.162837 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3566f4ef_8f6f_453d_a776_ac5332c2c2ff.slice/crio-a197e83502a83cb28e17a4e522267ce1d96ac8818a7327657c8c1d4c13a570aa WatchSource:0}: Error finding container a197e83502a83cb28e17a4e522267ce1d96ac8818a7327657c8c1d4c13a570aa: Status 404 returned error can't find the container with id a197e83502a83cb28e17a4e522267ce1d96ac8818a7327657c8c1d4c13a570aa Oct 30 14:09:10.237094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:10.237066 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7dfcdb7-r56ck" event={"ID":"3566f4ef-8f6f-453d-a776-ac5332c2c2ff","Type":"ContainerStarted","Data":"60e6fbe3ee9c74a1b6c10c7905483fa9377cf01b4583196eab45d2a00916243f"} Oct 30 14:09:10.237231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:10.237113 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7dfcdb7-r56ck" event={"ID":"3566f4ef-8f6f-453d-a776-ac5332c2c2ff","Type":"ContainerStarted","Data":"a197e83502a83cb28e17a4e522267ce1d96ac8818a7327657c8c1d4c13a570aa"} Oct 30 14:09:10.281592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:10.281513 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6c7dfcdb7-r56ck" podStartSLOduration=1.281499493 podStartE2EDuration="1.281499493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:09:10.280744309 +0000 UTC m=+101.619543359" watchObservedRunningTime="2026-10-30 14:09:10.281499493 +0000 UTC m=+101.620298502" Oct 30 14:09:13.021097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:13.021059 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:13.163350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:13.163319 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:19.848287 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:19.848244 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:19.848762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:19.848321 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:19.852959 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:19.852942 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:20.280960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:20.280934 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c7dfcdb7-r56ck" Oct 30 14:09:20.358492 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:20.358462 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:09:20.423774 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:20.423740 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:20.575050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:20.574968 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:28.784971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:28.784943 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:28.929194 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:28.929163 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:30.422625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:30.422584 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:30.564097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:30.564061 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:31.844172 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:09:31.844137 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:09:34.885881 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:34.885845 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:09:45.378711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.378676 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-79cf45cb5d-gphj5" podUID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" containerName="console" containerID="cri-o://57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0" gracePeriod=15 Oct 30 14:09:45.615381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.615359 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:09:45.697269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697240 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697275 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697299 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\" (UniqueName: \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697335 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697380 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697410 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697436 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697782 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697480 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\") pod \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\" (UID: \"3f4feda7-d8a8-4014-acaa-a0c922d2220f\") " Oct 30 14:09:45.697843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697774 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:09:45.697890 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697855 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:09:45.698013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.697987 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:09:45.698096 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.698064 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:09:45.698096 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.698070 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:09:45.699846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.699823 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:09:45.699933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.699850 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:09:45.699933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.699871 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4" pod "3f4feda7-d8a8-4014-acaa-a0c922d2220f" (UID: "3f4feda7-d8a8-4014-acaa-a0c922d2220f"). InnerVolumeSpecName "kube-api-access-zvqq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:09:45.798328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798289 5768 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798322 5768 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798335 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvqq4\" (UniqueName: \"kubernetes.io/projected/3f4feda7-d8a8-4014-acaa-a0c922d2220f-kube-api-access-zvqq4\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798349 5768 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-oauth-serving-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798363 5768 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798373 5768 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f4feda7-d8a8-4014-acaa-a0c922d2220f-console-oauth-config\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798384 5768 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f4feda7-d8a8-4014-acaa-a0c922d2220f-trusted-ca-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:45.798592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:45.798395 5768 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4feda7-d8a8-4014-acaa-a0c922d2220f-tmp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:09:46.368377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.368341 5768 generic.go:356] "Generic (PLEG): container finished" podID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" containerID="57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0" exitCode=0 Oct 30 14:09:46.368604 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.368392 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cf45cb5d-gphj5" Oct 30 14:09:46.368604 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.368400 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf45cb5d-gphj5" event={"ID":"3f4feda7-d8a8-4014-acaa-a0c922d2220f","Type":"ContainerDied","Data":"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0"} Oct 30 14:09:46.368604 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.368452 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cf45cb5d-gphj5" event={"ID":"3f4feda7-d8a8-4014-acaa-a0c922d2220f","Type":"ContainerDied","Data":"d787aa15139602842abe8603461d3461ce4cb23491190300fddb8de6be3d9cc5"} Oct 30 14:09:46.368604 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.368480 5768 scope.go:122] "RemoveContainer" containerID="57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0" Oct 30 14:09:46.376896 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.376880 5768 scope.go:122] "RemoveContainer" containerID="57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0" Oct 30 14:09:46.377151 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:09:46.377134 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0\": container with ID starting with 57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0 not found: ID does not exist" containerID="57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0" Oct 30 14:09:46.377208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.377159 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0"} err="failed to get container status \"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0\": rpc error: code = NotFound desc = could not find container \"57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0\": container with ID starting with 57c8d81dfb749871efee693d80395fd5eda760241d91c41ee942d3133b9ca9f0 not found: ID does not exist" Oct 30 14:09:46.420371 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.420342 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:09:46.432283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.432262 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cf45cb5d-gphj5"] Oct 30 14:09:46.781249 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:09:46.781215 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" path="/var/lib/kubelet/pods/3f4feda7-d8a8-4014-acaa-a0c922d2220f/volumes" Oct 30 14:10:00.733136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:10:00.733101 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:10:01.844150 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:10:01.844109 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:10:31.844069 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:10:31.844034 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:10:35.009002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:10:35.008965 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:01.843228 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:11:01.843187 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:11:20.642976 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:20.642935 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:20.815460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:20.815428 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:21.394486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.394455 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs"] Oct 30 14:11:21.394780 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.394767 5768 cpu_manager.go:414] "containerMap: removing container" podUID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" containerName="console" Oct 30 14:11:21.394827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.394783 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" containerName="console" Oct 30 14:11:21.394911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.394900 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f4feda7-d8a8-4014-acaa-a0c922d2220f" containerName="console" Oct 30 14:11:21.397952 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.397932 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.425337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.425310 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 14:11:21.425758 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.425737 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-mnzx8\"" Oct 30 14:11:21.425871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.425822 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 14:11:21.432082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.432057 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs"] Oct 30 14:11:21.556504 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.556471 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.556686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.556512 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.556686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.556599 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t4rq\" (UniqueName: \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.657951 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.657867 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.657951 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.657919 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.658420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.657963 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t4rq\" (UniqueName: \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.658420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.658258 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.658420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.658280 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.682670 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.682644 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t4rq\" (UniqueName: \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:21.713721 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:21.713698 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:22.008628 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:22.008589 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs"] Oct 30 14:11:22.013869 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:11:22.013844 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513d3735_7ebd_4a34_b8cf_6b2d7561c5b7.slice/crio-a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda WatchSource:0}: Error finding container a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda: Status 404 returned error can't find the container with id a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda Oct 30 14:11:22.702889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:22.702857 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerStarted","Data":"a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda"} Oct 30 14:11:27.722823 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:27.722788 5768 generic.go:356] "Generic (PLEG): container finished" podID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerID="f5187eca95e55001c499c8ddfa9a79ae4a01ee9e96e7a2370a7129fb3733a081" exitCode=0 Oct 30 14:11:27.722823 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:27.722822 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerDied","Data":"f5187eca95e55001c499c8ddfa9a79ae4a01ee9e96e7a2370a7129fb3733a081"} Oct 30 14:11:29.732111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:29.732079 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerStarted","Data":"75426603822dc8ceedec35603c9384ebf6c48ce446fef2da4433055ca10e1ef7"} Oct 30 14:11:30.737657 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:30.737622 5768 generic.go:356] "Generic (PLEG): container finished" podID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerID="75426603822dc8ceedec35603c9384ebf6c48ce446fef2da4433055ca10e1ef7" exitCode=0 Oct 30 14:11:30.738084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:30.737694 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerDied","Data":"75426603822dc8ceedec35603c9384ebf6c48ce446fef2da4433055ca10e1ef7"} Oct 30 14:11:31.848891 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:11:31.848850 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:11:35.134676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:35.134639 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:36.762665 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:36.762630 5768 generic.go:356] "Generic (PLEG): container finished" podID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerID="7d96b38491a9a34c7f7d43ffebc62d0461e219cddc599b7d660d50a673bff34e" exitCode=0 Oct 30 14:11:36.763035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:36.762717 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerDied","Data":"7d96b38491a9a34c7f7d43ffebc62d0461e219cddc599b7d660d50a673bff34e"} Oct 30 14:11:37.889742 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.889714 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:37.996896 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.996854 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\") pod \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " Oct 30 14:11:37.997069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.996945 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\") pod \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " Oct 30 14:11:37.997069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.996981 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\" (UniqueName: \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\") pod \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\" (UID: \"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7\") " Oct 30 14:11:37.997682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.997647 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle" pod "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" (UID: "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:11:37.999411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:37.999385 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq" pod "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" (UID: "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7"). InnerVolumeSpecName "kube-api-access-2t4rq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:11:38.002199 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.002173 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util" pod "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" (UID: "513d3735-7ebd-4a34-b8cf-6b2d7561c5b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:11:38.097652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.097575 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:38.097652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.097605 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:38.097652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.097616 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t4rq\" (UniqueName: \"kubernetes.io/projected/513d3735-7ebd-4a34-b8cf-6b2d7561c5b7-kube-api-access-2t4rq\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:38.771320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.771287 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" event={"ID":"513d3735-7ebd-4a34-b8cf-6b2d7561c5b7","Type":"ContainerDied","Data":"a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda"} Oct 30 14:11:38.771490 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.771337 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a685331efd9292659bf77647ea7debe0680628bf69e5f29fa47dab57ca8f4cda" Oct 30 14:11:38.771490 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:38.771296 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2z2zs" Oct 30 14:11:42.654889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:42.654850 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:43.030015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:43.029970 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:44.607735 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.607707 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57"] Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.607999 5768 cpu_manager.go:414] "containerMap: removing container" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="extract" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608009 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="extract" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608023 5768 cpu_manager.go:414] "containerMap: removing container" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="pull" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608027 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="pull" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608034 5768 cpu_manager.go:414] "containerMap: removing container" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="util" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608040 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="util" Oct 30 14:11:44.608113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.608091 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="513d3735-7ebd-4a34-b8cf-6b2d7561c5b7" containerName="extract" Oct 30 14:11:44.638705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.638681 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57"] Oct 30 14:11:44.638869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.638788 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.643288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.643262 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53146c16-cf2c-487a-b5da-7d2084ab6b25-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.643434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.643299 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzb8\" (UniqueName: \"kubernetes.io/projected/53146c16-cf2c-487a-b5da-7d2084ab6b25-kube-api-access-vfzb8\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.654470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.654448 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:11:44.654611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.654520 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Oct 30 14:11:44.654611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.654525 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w8q5n\"" Oct 30 14:11:44.744261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.744227 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53146c16-cf2c-487a-b5da-7d2084ab6b25-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.744413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.744266 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzb8\" (UniqueName: \"kubernetes.io/projected/53146c16-cf2c-487a-b5da-7d2084ab6b25-kube-api-access-vfzb8\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.744651 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.744620 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53146c16-cf2c-487a-b5da-7d2084ab6b25-tmp\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.771442 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.771414 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzb8\" (UniqueName: \"kubernetes.io/projected/53146c16-cf2c-487a-b5da-7d2084ab6b25-kube-api-access-vfzb8\") pod \"cert-manager-operator-controller-manager-89fdbf7dc-78q57\" (UID: \"53146c16-cf2c-487a-b5da-7d2084ab6b25\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:44.963492 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:44.963463 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" Oct 30 14:11:45.306228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:45.306151 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57"] Oct 30 14:11:45.311643 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:11:45.311613 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53146c16_cf2c_487a_b5da_7d2084ab6b25.slice/crio-b9c223ca748441b3f313fa470e61ae20b17adcd6c23b8064c684046e003422b2 WatchSource:0}: Error finding container b9c223ca748441b3f313fa470e61ae20b17adcd6c23b8064c684046e003422b2: Status 404 returned error can't find the container with id b9c223ca748441b3f313fa470e61ae20b17adcd6c23b8064c684046e003422b2 Oct 30 14:11:45.799147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:45.799112 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" event={"ID":"53146c16-cf2c-487a-b5da-7d2084ab6b25","Type":"ContainerStarted","Data":"b9c223ca748441b3f313fa470e61ae20b17adcd6c23b8064c684046e003422b2"} Oct 30 14:11:45.915818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:45.915778 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:46.056805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:46.056723 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:47.809426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:47.809391 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" event={"ID":"53146c16-cf2c-487a-b5da-7d2084ab6b25","Type":"ContainerStarted","Data":"d67038b1967d522c7f83e1ffa993c0ac01b80daa93dee09304b78f61ee5da400"} Oct 30 14:11:47.878168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:47.878074 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-89fdbf7dc-78q57" podStartSLOduration=1.629834799 podStartE2EDuration="3.878059906s" totalImagesPullingTime="2.248225107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:11:47.86613637 +0000 UTC m=+259.204935404" watchObservedRunningTime="2026-10-30 14:11:47.878059906 +0000 UTC m=+259.216858906" Oct 30 14:11:48.341782 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.341743 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:48.518470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.518431 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:48.607706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.607628 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k"] Oct 30 14:11:48.630756 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.630734 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.640267 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.640242 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k"] Oct 30 14:11:48.670016 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.669985 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 14:11:48.670184 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.670079 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 14:11:48.670266 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.670252 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"61b1ff68c7255ee5c5329fe19a5d96293a9578-ce91a85d-dockercfg-n8rg6\"" Oct 30 14:11:48.675833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.675809 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfg8p\" (UniqueName: \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.675974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.675840 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.675974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.675960 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.755820 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.755787 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:48.776805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.776773 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfg8p\" (UniqueName: \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.776973 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.776815 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.776973 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.776872 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.777246 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.777227 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.777342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.777322 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.803571 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.803522 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfg8p\" (UniqueName: \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\") pod \"61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:48.922093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.922055 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:48.932393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.932364 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w"] Oct 30 14:11:48.954795 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.954775 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:48.957968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.957947 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w"] Oct 30 14:11:48.969970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.969949 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 30 14:11:48.969970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.969952 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 30 14:11:48.978445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.978410 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:48.978620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.978491 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhh8\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-kube-api-access-fqhh8\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:48.983355 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:48.983339 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:49.079288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.079252 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhh8\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-kube-api-access-fqhh8\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:49.079442 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.079318 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:49.103064 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.103031 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:49.103352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.103330 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhh8\" (UniqueName: \"kubernetes.io/projected/47e47449-28de-4ebc-bb64-ea3a77f22bfc-kube-api-access-fqhh8\") pod \"cert-manager-webhook-5dbbbf75cc-jjj5w\" (UID: \"47e47449-28de-4ebc-bb64-ea3a77f22bfc\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:49.295923 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.295840 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:49.300148 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.300126 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k"] Oct 30 14:11:49.305770 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:11:49.305743 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f6d018_801c_4171_96a1_27dea2b5f344.slice/crio-26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037 WatchSource:0}: Error finding container 26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037: Status 404 returned error can't find the container with id 26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037 Oct 30 14:11:49.618130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.618064 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w"] Oct 30 14:11:49.623976 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:11:49.623946 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47e47449_28de_4ebc_bb64_ea3a77f22bfc.slice/crio-aa25b73d6f999dc6431c48f1dce03d264f9b2734a76da16a64e8ecdfb3b264f3 WatchSource:0}: Error finding container aa25b73d6f999dc6431c48f1dce03d264f9b2734a76da16a64e8ecdfb3b264f3: Status 404 returned error can't find the container with id aa25b73d6f999dc6431c48f1dce03d264f9b2734a76da16a64e8ecdfb3b264f3 Oct 30 14:11:49.818252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.818224 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" event={"ID":"47e47449-28de-4ebc-bb64-ea3a77f22bfc","Type":"ContainerStarted","Data":"aa25b73d6f999dc6431c48f1dce03d264f9b2734a76da16a64e8ecdfb3b264f3"} Oct 30 14:11:49.819624 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.819602 5768 generic.go:356] "Generic (PLEG): container finished" podID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerID="8cf8cbd05933fe4fad57b5f6476cfea098ddd0ee72ba29e53900f368151053f5" exitCode=0 Oct 30 14:11:49.819763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.819695 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" event={"ID":"c8f6d018-801c-4171-96a1-27dea2b5f344","Type":"ContainerDied","Data":"8cf8cbd05933fe4fad57b5f6476cfea098ddd0ee72ba29e53900f368151053f5"} Oct 30 14:11:49.819763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:49.819739 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" event={"ID":"c8f6d018-801c-4171-96a1-27dea2b5f344","Type":"ContainerStarted","Data":"26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037"} Oct 30 14:11:50.740764 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:50.740733 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:51.189104 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:51.189049 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:51.463251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:51.463170 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:52.325065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.325027 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf"] Oct 30 14:11:52.329478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.329453 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.348282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.348260 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z26n2\"" Oct 30 14:11:52.358846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.358822 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf"] Oct 30 14:11:52.386222 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.386193 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:52.409201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.409174 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.409328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.409236 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cfs\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-kube-api-access-z6cfs\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.511215 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.511127 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.511399 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.511225 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cfs\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-kube-api-access-z6cfs\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.531418 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.531366 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:52.535605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.535583 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.535960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.535943 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cfs\" (UniqueName: \"kubernetes.io/projected/167a131b-65fe-4400-a350-5f26dbc32b7b-kube-api-access-z6cfs\") pod \"cert-manager-cainjector-5c57bbd4fc-8wlpf\" (UID: \"167a131b-65fe-4400-a350-5f26dbc32b7b\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.643332 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.643305 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" Oct 30 14:11:52.835796 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.835707 5768 generic.go:356] "Generic (PLEG): container finished" podID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerID="00d5f903e994e2af06a5b5248c338c3c69b9205f6c2665a193aadf14425dd82b" exitCode=0 Oct 30 14:11:52.835959 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.835796 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" event={"ID":"c8f6d018-801c-4171-96a1-27dea2b5f344","Type":"ContainerDied","Data":"00d5f903e994e2af06a5b5248c338c3c69b9205f6c2665a193aadf14425dd82b"} Oct 30 14:11:52.950950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:52.950886 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf"] Oct 30 14:11:52.956598 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:11:52.956572 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod167a131b_65fe_4400_a350_5f26dbc32b7b.slice/crio-ecbc3fce67f3ffc4d507f74d8a11878b71915a4917efc9cfb6c582b0ecfc9af4 WatchSource:0}: Error finding container ecbc3fce67f3ffc4d507f74d8a11878b71915a4917efc9cfb6c582b0ecfc9af4: Status 404 returned error can't find the container with id ecbc3fce67f3ffc4d507f74d8a11878b71915a4917efc9cfb6c582b0ecfc9af4 Oct 30 14:11:53.306818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:53.306787 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:53.450274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:53.450239 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:11:53.845232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:53.845201 5768 generic.go:356] "Generic (PLEG): container finished" podID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerID="520879a1590337dddb096196ec3f79d204861c59c7e9daebb24fee79671dfe52" exitCode=0 Oct 30 14:11:53.845360 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:53.845284 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" event={"ID":"c8f6d018-801c-4171-96a1-27dea2b5f344","Type":"ContainerDied","Data":"520879a1590337dddb096196ec3f79d204861c59c7e9daebb24fee79671dfe52"} Oct 30 14:11:53.846807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:53.846783 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" event={"ID":"167a131b-65fe-4400-a350-5f26dbc32b7b","Type":"ContainerStarted","Data":"ecbc3fce67f3ffc4d507f74d8a11878b71915a4917efc9cfb6c582b0ecfc9af4"} Oct 30 14:11:54.853219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:54.853128 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" event={"ID":"47e47449-28de-4ebc-bb64-ea3a77f22bfc","Type":"ContainerStarted","Data":"8ef0bff97d854c09e5a8c99b99dff97d6ea4b7ce1f8e8ef9f910faf37907861b"} Oct 30 14:11:54.853219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:54.853213 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:11:54.855267 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:54.855243 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" event={"ID":"167a131b-65fe-4400-a350-5f26dbc32b7b","Type":"ContainerStarted","Data":"a69bf53470938450bad34459f68a1902c100e46debd41ca0d0c501c9b6be5f5c"} Oct 30 14:11:54.902684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:54.902636 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" podStartSLOduration=2.756343359 podStartE2EDuration="6.902621244s" totalImagesPullingTime="4.146277885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:11:54.901960645 +0000 UTC m=+266.240759656" watchObservedRunningTime="2026-10-30 14:11:54.902621244 +0000 UTC m=+266.241420251" Oct 30 14:11:54.946059 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:54.946008 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-8wlpf" podStartSLOduration=1.401694366 podStartE2EDuration="2.945993722s" totalImagesPullingTime="1.544299356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:11:54.945097641 +0000 UTC m=+266.283896652" watchObservedRunningTime="2026-10-30 14:11:54.945993722 +0000 UTC m=+266.284792733" Oct 30 14:11:55.000632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.000603 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:55.032865 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.032824 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\") pod \"c8f6d018-801c-4171-96a1-27dea2b5f344\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " Oct 30 14:11:55.033025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.032891 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\" (UniqueName: \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\") pod \"c8f6d018-801c-4171-96a1-27dea2b5f344\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " Oct 30 14:11:55.033025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.032945 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\") pod \"c8f6d018-801c-4171-96a1-27dea2b5f344\" (UID: \"c8f6d018-801c-4171-96a1-27dea2b5f344\") " Oct 30 14:11:55.033382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.033354 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle" pod "c8f6d018-801c-4171-96a1-27dea2b5f344" (UID: "c8f6d018-801c-4171-96a1-27dea2b5f344"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:11:55.035018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.034993 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p" pod "c8f6d018-801c-4171-96a1-27dea2b5f344" (UID: "c8f6d018-801c-4171-96a1-27dea2b5f344"). InnerVolumeSpecName "kube-api-access-gfg8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:11:55.037082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.037047 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util" pod "c8f6d018-801c-4171-96a1-27dea2b5f344" (UID: "c8f6d018-801c-4171-96a1-27dea2b5f344"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:11:55.133594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.133507 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:55.133594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.133536 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8f6d018-801c-4171-96a1-27dea2b5f344-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:55.133594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.133568 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfg8p\" (UniqueName: \"kubernetes.io/projected/c8f6d018-801c-4171-96a1-27dea2b5f344-kube-api-access-gfg8p\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:11:55.861342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.861307 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" Oct 30 14:11:55.861342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.861328 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/61b1ff68c7255ee5c5329fe19a5d96293a95788d9734a0a79829e8dc85lfs9k" event={"ID":"c8f6d018-801c-4171-96a1-27dea2b5f344","Type":"ContainerDied","Data":"26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037"} Oct 30 14:11:55.861895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:55.861377 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26c56cdbc103538f5a82dc36bba510c036a7572682baa7d293cb255e96201037" Oct 30 14:11:58.435591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:11:58.435536 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:00.219178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:00.219142 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:00.372415 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:00.372380 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:00.863380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:00.863350 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-jjj5w" Oct 30 14:12:01.843497 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:12:01.843464 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:12:05.922204 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:05.922164 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:06.188182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:06.188099 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:07.743603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.743569 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:07.749747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.749728 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8"] Oct 30 14:12:07.750028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750017 5768 cpu_manager.go:414] "containerMap: removing container" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="pull" Oct 30 14:12:07.750069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750030 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="pull" Oct 30 14:12:07.750069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750043 5768 cpu_manager.go:414] "containerMap: removing container" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="extract" Oct 30 14:12:07.750069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750048 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="extract" Oct 30 14:12:07.750069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750066 5768 cpu_manager.go:414] "containerMap: removing container" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="util" Oct 30 14:12:07.750190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750070 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="util" Oct 30 14:12:07.750190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.750122 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8f6d018-801c-4171-96a1-27dea2b5f344" containerName="extract" Oct 30 14:12:07.753781 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.753764 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.780646 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.780618 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 14:12:07.780768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.780749 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-9n29w\"" Oct 30 14:12:07.780843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.780819 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 14:12:07.781734 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.781712 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8"] Oct 30 14:12:07.835842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.835809 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.836020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.835876 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssdr\" (UniqueName: \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.836020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.835983 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.936717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.936687 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.936915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.936755 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssdr\" (UniqueName: \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.936915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.936782 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.937116 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.937095 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.937156 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.937125 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:07.961474 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:07.961443 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssdr\" (UniqueName: \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:08.069821 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:08.069739 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:08.368953 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:08.368855 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8"] Oct 30 14:12:08.374074 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:12:08.374048 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1a1c3b_009a_4583_834f_20666c01e992.slice/crio-677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee WatchSource:0}: Error finding container 677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee: Status 404 returned error can't find the container with id 677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee Oct 30 14:12:08.914540 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:08.914502 5768 generic.go:356] "Generic (PLEG): container finished" podID="cc1a1c3b-009a-4583-834f-20666c01e992" containerID="1a888290a279c2a17d92106d6379fd0fc2ae2e8c57ad7d6b90e0487e375d8553" exitCode=0 Oct 30 14:12:08.914966 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:08.914592 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" event={"ID":"cc1a1c3b-009a-4583-834f-20666c01e992","Type":"ContainerDied","Data":"1a888290a279c2a17d92106d6379fd0fc2ae2e8c57ad7d6b90e0487e375d8553"} Oct 30 14:12:08.914966 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:08.914655 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" event={"ID":"cc1a1c3b-009a-4583-834f-20666c01e992","Type":"ContainerStarted","Data":"677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee"} Oct 30 14:12:09.920628 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:09.920597 5768 generic.go:356] "Generic (PLEG): container finished" podID="cc1a1c3b-009a-4583-834f-20666c01e992" containerID="04978682a8d8a4237e4b3bff40540f2d3049d618b22ee880c98856b0b06a2efe" exitCode=0 Oct 30 14:12:09.921015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:09.920681 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" event={"ID":"cc1a1c3b-009a-4583-834f-20666c01e992","Type":"ContainerDied","Data":"04978682a8d8a4237e4b3bff40540f2d3049d618b22ee880c98856b0b06a2efe"} Oct 30 14:12:10.926748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:10.926708 5768 generic.go:356] "Generic (PLEG): container finished" podID="cc1a1c3b-009a-4583-834f-20666c01e992" containerID="327d7a09d82a375020671c5ef3146de99f582b82b9cb111cc0df0272cb43132d" exitCode=0 Oct 30 14:12:10.927163 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:10.926800 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" event={"ID":"cc1a1c3b-009a-4583-834f-20666c01e992","Type":"ContainerDied","Data":"327d7a09d82a375020671c5ef3146de99f582b82b9cb111cc0df0272cb43132d"} Oct 30 14:12:12.056457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.056431 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:12.176003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.175968 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\") pod \"cc1a1c3b-009a-4583-834f-20666c01e992\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " Oct 30 14:12:12.176003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.176004 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\") pod \"cc1a1c3b-009a-4583-834f-20666c01e992\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " Oct 30 14:12:12.176253 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.176036 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\" (UniqueName: \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\") pod \"cc1a1c3b-009a-4583-834f-20666c01e992\" (UID: \"cc1a1c3b-009a-4583-834f-20666c01e992\") " Oct 30 14:12:12.176598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.176571 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle" pod "cc1a1c3b-009a-4583-834f-20666c01e992" (UID: "cc1a1c3b-009a-4583-834f-20666c01e992"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:12:12.178309 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.178286 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr" pod "cc1a1c3b-009a-4583-834f-20666c01e992" (UID: "cc1a1c3b-009a-4583-834f-20666c01e992"). InnerVolumeSpecName "kube-api-access-jssdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:12:12.181920 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.181871 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util" pod "cc1a1c3b-009a-4583-834f-20666c01e992" (UID: "cc1a1c3b-009a-4583-834f-20666c01e992"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:12:12.276507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.276475 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:12:12.276507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.276501 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1a1c3b-009a-4583-834f-20666c01e992-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:12:12.276507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.276512 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jssdr\" (UniqueName: \"kubernetes.io/projected/cc1a1c3b-009a-4583-834f-20666c01e992-kube-api-access-jssdr\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:12:12.937211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.937177 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" Oct 30 14:12:12.937211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.937194 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71nmxn8" event={"ID":"cc1a1c3b-009a-4583-834f-20666c01e992","Type":"ContainerDied","Data":"677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee"} Oct 30 14:12:12.937420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:12.937255 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="677f21c412bfcf23b9e3f6e9bed62a2480f13d624e126744dfccece695fd2eee" Oct 30 14:12:22.376240 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:22.376209 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:22.552351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:22.552314 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:23.225259 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.225230 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:23.374516 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374489 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8"] Oct 30 14:12:23.374821 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374809 5768 cpu_manager.go:414] "containerMap: removing container" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="pull" Oct 30 14:12:23.374864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374823 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="pull" Oct 30 14:12:23.374864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374840 5768 cpu_manager.go:414] "containerMap: removing container" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="extract" Oct 30 14:12:23.374864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374847 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="extract" Oct 30 14:12:23.374864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374856 5768 cpu_manager.go:414] "containerMap: removing container" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="util" Oct 30 14:12:23.374864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374861 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="util" Oct 30 14:12:23.375003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.374925 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc1a1c3b-009a-4583-834f-20666c01e992" containerName="extract" Oct 30 14:12:23.381973 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.381951 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.403296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.403274 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 14:12:23.403406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.403391 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 14:12:23.413087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.413064 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 14:12:23.413223 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.413135 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6f7bn\"" Oct 30 14:12:23.413223 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.413171 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 14:12:23.413314 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.413234 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\"" Oct 30 14:12:23.426299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.426273 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8"] Oct 30 14:12:23.470979 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.470943 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.471104 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.471008 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.471175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.471107 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.471175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.471140 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.471257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.471236 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnpr\" (UniqueName: \"kubernetes.io/projected/4f0ef27a-6b93-408c-a44e-7f285e082a15-kube-api-access-mvnpr\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.471303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.471287 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.572699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572617 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.572699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572650 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.572699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572670 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.572699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572697 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnpr\" (UniqueName: \"kubernetes.io/projected/4f0ef27a-6b93-408c-a44e-7f285e082a15-kube-api-access-mvnpr\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.573024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572814 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.573024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.572871 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.573184 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.573122 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-manifests\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.575341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.575309 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f0ef27a-6b93-408c-a44e-7f285e082a15-tmp\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.575460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.575407 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-webhook-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.575460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.575412 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.575594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.575528 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f0ef27a-6b93-408c-a44e-7f285e082a15-metrics-cert\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.582857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.582830 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:23.598886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.598866 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnpr\" (UniqueName: \"kubernetes.io/projected/4f0ef27a-6b93-408c-a44e-7f285e082a15-kube-api-access-mvnpr\") pod \"opendatahub-operator-controller-manager-6749b785b4-n4sh8\" (UID: \"4f0ef27a-6b93-408c-a44e-7f285e082a15\") " pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.699507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.699478 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:23.744648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.744611 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:23.886486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:23.886397 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:24.061235 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:12:24.061209 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0ef27a_6b93_408c_a44e_7f285e082a15.slice/crio-dd24c2e9d66b019e36f31db88286a13826bb0fbec5624900c1ff19e460a52fb6 WatchSource:0}: Error finding container dd24c2e9d66b019e36f31db88286a13826bb0fbec5624900c1ff19e460a52fb6: Status 404 returned error can't find the container with id dd24c2e9d66b019e36f31db88286a13826bb0fbec5624900c1ff19e460a52fb6 Oct 30 14:12:24.065056 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:24.065035 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8"] Oct 30 14:12:24.831584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:24.831484 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:24.979791 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:24.979707 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:24.994186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:24.994153 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" event={"ID":"4f0ef27a-6b93-408c-a44e-7f285e082a15","Type":"ContainerStarted","Data":"dd24c2e9d66b019e36f31db88286a13826bb0fbec5624900c1ff19e460a52fb6"} Oct 30 14:12:25.587673 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:25.587637 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:25.782986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:25.782949 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:28.012483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:28.012449 5768 generic.go:356] "Generic (PLEG): container finished" podID="4f0ef27a-6b93-408c-a44e-7f285e082a15" containerID="ecea860c1125ec94e3b0fd900a3c997e488b64ac51bb65b2f902e94b9027a5ea" exitCode=0 Oct 30 14:12:28.012922 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:28.012544 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" event={"ID":"4f0ef27a-6b93-408c-a44e-7f285e082a15","Type":"ContainerDied","Data":"ecea860c1125ec94e3b0fd900a3c997e488b64ac51bb65b2f902e94b9027a5ea"} Oct 30 14:12:29.018654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:29.018606 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" event={"ID":"4f0ef27a-6b93-408c-a44e-7f285e082a15","Type":"ContainerStarted","Data":"2e9c3381cf13de9645e32c38d6f5961d0b4f6bfbc380a20715c86653aef27603"} Oct 30 14:12:29.019122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:29.018794 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:29.107067 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:29.107012 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" podStartSLOduration=2.351753168 podStartE2EDuration="6.106999438s" totalImagesPullingTime="3.320192895s" totalInitContainerRuntime="435.053375ms" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:29.094500504 +0000 UTC m=+300.433299515" watchObservedRunningTime="2026-10-30 14:12:29.106999438 +0000 UTC m=+300.445798438" Oct 30 14:12:30.241122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:30.241091 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:30.382959 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:30.382922 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:31.844608 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:12:31.844569 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:12:35.255013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:35.254976 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:40.025201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:40.025170 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6749b785b4-n4sh8" Oct 30 14:12:41.284629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.284594 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr"] Oct 30 14:12:41.287791 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.287771 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.315121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315093 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xjrbd\"" Oct 30 14:12:41.315272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315133 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Oct 30 14:12:41.315272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315150 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Oct 30 14:12:41.315431 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315414 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Oct 30 14:12:41.315521 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315432 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Oct 30 14:12:41.315833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.315814 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Oct 30 14:12:41.316958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.316919 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr"] Oct 30 14:12:41.329541 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.329517 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.329676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.329654 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2jk\" (UniqueName: \"kubernetes.io/projected/83538e05-58a1-48a0-94ab-981da8dae6d4-kube-api-access-fq2jk\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.329741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.329692 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83538e05-58a1-48a0-94ab-981da8dae6d4-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.329802 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.329765 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.430332 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.430304 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.430533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.430364 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2jk\" (UniqueName: \"kubernetes.io/projected/83538e05-58a1-48a0-94ab-981da8dae6d4-kube-api-access-fq2jk\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.430533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.430394 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83538e05-58a1-48a0-94ab-981da8dae6d4-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.430533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.430416 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.431143 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.431117 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83538e05-58a1-48a0-94ab-981da8dae6d4-manager-config\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.432954 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.432930 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.433120 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.433101 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83538e05-58a1-48a0-94ab-981da8dae6d4-metrics-cert\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.453787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.453765 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2jk\" (UniqueName: \"kubernetes.io/projected/83538e05-58a1-48a0-94ab-981da8dae6d4-kube-api-access-fq2jk\") pod \"lws-controller-manager-5ffcfd7c54-rgjnr\" (UID: \"83538e05-58a1-48a0-94ab-981da8dae6d4\") " pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.599760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.599679 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:41.898938 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:41.898854 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr"] Oct 30 14:12:41.903869 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:12:41.903842 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83538e05_58a1_48a0_94ab_981da8dae6d4.slice/crio-f88c6ad4af242b2bbacb7a80a96b065f390e094b2afb94358debc90fd1b55c7d WatchSource:0}: Error finding container f88c6ad4af242b2bbacb7a80a96b065f390e094b2afb94358debc90fd1b55c7d: Status 404 returned error can't find the container with id f88c6ad4af242b2bbacb7a80a96b065f390e094b2afb94358debc90fd1b55c7d Oct 30 14:12:42.072384 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:42.072353 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" event={"ID":"83538e05-58a1-48a0-94ab-981da8dae6d4","Type":"ContainerStarted","Data":"f88c6ad4af242b2bbacb7a80a96b065f390e094b2afb94358debc90fd1b55c7d"} Oct 30 14:12:42.612058 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:42.612010 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:42.785252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:42.785217 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:43.136119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.136090 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8"] Oct 30 14:12:43.139897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.139876 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.155740 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.155718 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 30 14:12:43.155891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.155830 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 30 14:12:43.167992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.167968 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 14:12:43.168861 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.168831 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7rf2q\"" Oct 30 14:12:43.168970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.168909 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 14:12:43.169029 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.169005 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:43.169892 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.169872 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8"] Oct 30 14:12:43.247612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.247568 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20fd2942-cf8b-456c-a7f8-309b24260c80-tls-certs\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.247793 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.247690 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fd2942-cf8b-456c-a7f8-309b24260c80-tmp\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.247793 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.247738 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhcw\" (UniqueName: \"kubernetes.io/projected/20fd2942-cf8b-456c-a7f8-309b24260c80-kube-api-access-fmhcw\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.342912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.342883 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:43.348884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.348863 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fd2942-cf8b-456c-a7f8-309b24260c80-tmp\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.348967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.348903 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhcw\" (UniqueName: \"kubernetes.io/projected/20fd2942-cf8b-456c-a7f8-309b24260c80-kube-api-access-fmhcw\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.348967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.348944 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20fd2942-cf8b-456c-a7f8-309b24260c80-tls-certs\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.351171 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.351156 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20fd2942-cf8b-456c-a7f8-309b24260c80-tmp\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.351496 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.351474 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20fd2942-cf8b-456c-a7f8-309b24260c80-tls-certs\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.372791 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.372767 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhcw\" (UniqueName: \"kubernetes.io/projected/20fd2942-cf8b-456c-a7f8-309b24260c80-kube-api-access-fmhcw\") pod \"kube-auth-proxy-847b5f84b8-tx5r8\" (UID: \"20fd2942-cf8b-456c-a7f8-309b24260c80\") " pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.455080 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.455056 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" Oct 30 14:12:43.753336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:43.753307 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8"] Oct 30 14:12:43.756654 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:12:43.756632 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fd2942_cf8b_456c_a7f8_309b24260c80.slice/crio-6075b4c4c67234effcedd1866492dd1a3b0782742061070ff1c9c3998d11a1be WatchSource:0}: Error finding container 6075b4c4c67234effcedd1866492dd1a3b0782742061070ff1c9c3998d11a1be: Status 404 returned error can't find the container with id 6075b4c4c67234effcedd1866492dd1a3b0782742061070ff1c9c3998d11a1be Oct 30 14:12:44.083215 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:44.083130 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" event={"ID":"83538e05-58a1-48a0-94ab-981da8dae6d4","Type":"ContainerStarted","Data":"0e978d9bd051bf7a29bc5fb075e875c7b4872c265891cc2adac45d71919c2132"} Oct 30 14:12:44.083215 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:44.083202 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:12:44.084222 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:44.084202 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" event={"ID":"20fd2942-cf8b-456c-a7f8-309b24260c80","Type":"ContainerStarted","Data":"6075b4c4c67234effcedd1866492dd1a3b0782742061070ff1c9c3998d11a1be"} Oct 30 14:12:44.143494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:44.143409 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" podStartSLOduration=1.6881075920000002 podStartE2EDuration="3.143389764s" totalImagesPullingTime="1.455282172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:44.143006703 +0000 UTC m=+315.481805713" watchObservedRunningTime="2026-10-30 14:12:44.143389764 +0000 UTC m=+315.482188780" Oct 30 14:12:44.840031 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:44.839981 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:45.006501 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:45.006463 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:46.245370 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:46.245318 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:46.711470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:46.711438 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:47.040115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:47.040030 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:47.098544 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:47.098511 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" event={"ID":"20fd2942-cf8b-456c-a7f8-309b24260c80","Type":"ContainerStarted","Data":"67f41ed931aa9ec7029bf8102f4b9fab7f7ac9f4dc199cb67c8b6dcd0309e59c"} Oct 30 14:12:47.149516 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:47.149469 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-847b5f84b8-tx5r8" podStartSLOduration=1.7559315070000001 podStartE2EDuration="4.14945715s" totalImagesPullingTime="2.393525643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:12:47.148717326 +0000 UTC m=+318.487516357" watchObservedRunningTime="2026-10-30 14:12:47.14945715 +0000 UTC m=+318.488256161" Oct 30 14:12:47.411154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:47.411075 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:48.543340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:48.543307 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:48.732616 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:48.732574 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:49.567908 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:49.567872 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:49.793565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:49.793509 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:49.956219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:49.956167 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:12:55.090662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:12:55.090632 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ffcfd7c54-rgjnr" Oct 30 14:13:01.684311 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:01.684275 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:01.844464 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:13:01.844434 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:13:01.877990 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:01.877959 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:29.852883 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:29.852841 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:29.991162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:29.991128 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:31.844534 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:13:31.844502 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:13:32.749242 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:32.749207 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:32.892042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:32.892009 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:35.397745 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:35.397708 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:48.824665 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:48.824585 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:48.970319 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:48.970283 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:49.126399 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:49.126321 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:49.288469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:49.288438 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:49.646669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:49.646605 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:51.541001 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:51.540954 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:51.697201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:51.697169 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:51.841137 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:51.841059 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:13:51.983759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:13:51.983719 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:14:01.844826 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:14:01.844784 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:14:31.843993 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:14:31.843951 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:14:35.530081 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:35.530048 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:14:55.918024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:55.917992 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:14:56.081595 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:56.081525 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:14:58.735905 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.735861 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh"] Oct 30 14:14:58.738895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.738875 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.767485 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.767450 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 14:14:58.767485 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.767466 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 14:14:58.767676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.767511 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-vztc5\"" Oct 30 14:14:58.768867 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.768846 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh"] Oct 30 14:14:58.841748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.841700 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl"] Oct 30 14:14:58.844179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.844160 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:58.859160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.859135 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-9rrnr\"" Oct 30 14:14:58.871164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.871139 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl"] Oct 30 14:14:58.878325 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.878300 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.878438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.878328 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.878438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.878358 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5dh\" (UniqueName: \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.931115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.931085 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5"] Oct 30 14:14:58.933589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.933570 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:58.948320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.948294 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-jpplh\"" Oct 30 14:14:58.956891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.956864 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5"] Oct 30 14:14:58.979853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.979832 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5dh\" (UniqueName: \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.979998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.979871 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:58.979998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.979899 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7njgv\" (UniqueName: \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:58.980119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.980058 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.980119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.980083 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.980119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.980102 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:58.980386 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.980371 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:58.980424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:58.980402 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:59.004400 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.004342 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5dh\" (UniqueName: \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:59.029456 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.029428 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq"] Oct 30 14:14:59.031913 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.031896 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.047307 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.047289 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-rcl2t\"" Oct 30 14:14:59.052479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.052463 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:14:59.057436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.057417 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq"] Oct 30 14:14:59.081269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081245 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.081414 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081279 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xzgq\" (UniqueName: \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.081414 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081309 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.081510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081422 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.081510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081482 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7njgv\" (UniqueName: \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.081637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081604 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.081755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081739 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.081904 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.081885 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.106319 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.106288 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7njgv\" (UniqueName: \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.157212 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.157182 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:14:59.182700 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.182665 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xzgq\" (UniqueName: \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.182832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.182716 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.182832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.182735 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.182832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.182804 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgfl5\" (UniqueName: \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.182997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.182964 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.183052 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.183038 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.183105 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.183066 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.183249 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.183233 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.209207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.207715 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xzgq\" (UniqueName: \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.245762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.245731 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:14:59.284292 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.284259 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.284436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.284332 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.284436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.284354 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgfl5\" (UniqueName: \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.284690 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.284669 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.284766 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.284715 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.309302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.309278 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgfl5\" (UniqueName: \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.344210 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.344181 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:14:59.349315 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.349292 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh"] Oct 30 14:14:59.354768 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:14:59.354742 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c9fd9c_216d_4b6e_8b01_85d695e7d1e6.slice/crio-63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1 WatchSource:0}: Error finding container 63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1: Status 404 returned error can't find the container with id 63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1 Oct 30 14:14:59.480677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.480648 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl"] Oct 30 14:14:59.514813 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:14:59.514754 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1252f5_6052_4461_b47e_a53dcfabe04b.slice/crio-11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3 WatchSource:0}: Error finding container 11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3: Status 404 returned error can't find the container with id 11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3 Oct 30 14:14:59.542666 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.542641 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5"] Oct 30 14:14:59.547605 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:14:59.547582 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927a9f72_3acf_4597_8917_8c316d5e8046.slice/crio-c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396 WatchSource:0}: Error finding container c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396: Status 404 returned error can't find the container with id c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396 Oct 30 14:14:59.648699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.648671 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq"] Oct 30 14:14:59.660911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.660887 5768 generic.go:356] "Generic (PLEG): container finished" podID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerID="a24ce0ac11c5f68a13bd172393bd516f8521b69fb12728efade5f19e60391c40" exitCode=0 Oct 30 14:14:59.661009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.660966 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" event={"ID":"bd1252f5-6052-4461-b47e-a53dcfabe04b","Type":"ContainerDied","Data":"a24ce0ac11c5f68a13bd172393bd516f8521b69fb12728efade5f19e60391c40"} Oct 30 14:14:59.661071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.661012 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" event={"ID":"bd1252f5-6052-4461-b47e-a53dcfabe04b","Type":"ContainerStarted","Data":"11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3"} Oct 30 14:14:59.662094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.662075 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:14:59.662446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.662426 5768 generic.go:356] "Generic (PLEG): container finished" podID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerID="efb5597320ff130727668aea3f59963cbc01efee3d1255d01226208756b3b9f6" exitCode=0 Oct 30 14:14:59.662576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.662514 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" event={"ID":"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6","Type":"ContainerDied","Data":"efb5597320ff130727668aea3f59963cbc01efee3d1255d01226208756b3b9f6"} Oct 30 14:14:59.662654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.662588 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" event={"ID":"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6","Type":"ContainerStarted","Data":"63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1"} Oct 30 14:14:59.664053 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.664032 5768 generic.go:356] "Generic (PLEG): container finished" podID="927a9f72-3acf-4597-8917-8c316d5e8046" containerID="89dc8feb032d52ed874f04d38ce1eb4e357d23b3c861647032f9f8ff29100263" exitCode=0 Oct 30 14:14:59.664133 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.664061 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" event={"ID":"927a9f72-3acf-4597-8917-8c316d5e8046","Type":"ContainerDied","Data":"89dc8feb032d52ed874f04d38ce1eb4e357d23b3c861647032f9f8ff29100263"} Oct 30 14:14:59.664133 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:14:59.664086 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" event={"ID":"927a9f72-3acf-4597-8917-8c316d5e8046","Type":"ContainerStarted","Data":"c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396"} Oct 30 14:14:59.677288 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:14:59.677267 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba37f2e5_e660_4ba5_af1f_197289a81a96.slice/crio-7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40 WatchSource:0}: Error finding container 7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40: Status 404 returned error can't find the container with id 7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40 Oct 30 14:15:00.670493 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.670449 5768 generic.go:356] "Generic (PLEG): container finished" podID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerID="2e6b9a8b539ba74e357ed6c20a5fe123cd02f57f40fccca97da5cbebe25b9293" exitCode=0 Oct 30 14:15:00.670970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.670510 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" event={"ID":"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6","Type":"ContainerDied","Data":"2e6b9a8b539ba74e357ed6c20a5fe123cd02f57f40fccca97da5cbebe25b9293"} Oct 30 14:15:00.672465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.672438 5768 generic.go:356] "Generic (PLEG): container finished" podID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerID="2ad1a1a3d22b88cf6fb58995e40a20c7cc62ef4ffc5d2970acff8f91c6f6048e" exitCode=0 Oct 30 14:15:00.672585 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.672472 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" event={"ID":"bd1252f5-6052-4461-b47e-a53dcfabe04b","Type":"ContainerDied","Data":"2ad1a1a3d22b88cf6fb58995e40a20c7cc62ef4ffc5d2970acff8f91c6f6048e"} Oct 30 14:15:00.674004 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.673986 5768 generic.go:356] "Generic (PLEG): container finished" podID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerID="34232e5e3857486e0c5f220ed47c806cf211bc304780a1e9dfe6d950a1e12ffb" exitCode=0 Oct 30 14:15:00.674081 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.674026 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" event={"ID":"ba37f2e5-e660-4ba5-af1f-197289a81a96","Type":"ContainerDied","Data":"34232e5e3857486e0c5f220ed47c806cf211bc304780a1e9dfe6d950a1e12ffb"} Oct 30 14:15:00.674081 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:00.674063 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" event={"ID":"ba37f2e5-e660-4ba5-af1f-197289a81a96","Type":"ContainerStarted","Data":"7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40"} Oct 30 14:15:01.681353 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.681319 5768 generic.go:356] "Generic (PLEG): container finished" podID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerID="580ec4adcec12810218b6fe10b72842a6d69a233f44eea209dda2945032e57be" exitCode=0 Oct 30 14:15:01.681800 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.681399 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" event={"ID":"bd1252f5-6052-4461-b47e-a53dcfabe04b","Type":"ContainerDied","Data":"580ec4adcec12810218b6fe10b72842a6d69a233f44eea209dda2945032e57be"} Oct 30 14:15:01.683169 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.683146 5768 generic.go:356] "Generic (PLEG): container finished" podID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerID="3ca804b4a4aa3638bf5e8161a41f7ca8fefc8273dd94d27e69c0e4f64282d678" exitCode=0 Oct 30 14:15:01.683252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.683228 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" event={"ID":"ba37f2e5-e660-4ba5-af1f-197289a81a96","Type":"ContainerDied","Data":"3ca804b4a4aa3638bf5e8161a41f7ca8fefc8273dd94d27e69c0e4f64282d678"} Oct 30 14:15:01.685713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.685694 5768 generic.go:356] "Generic (PLEG): container finished" podID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerID="7c333995935d110f677fcd4ff4ba8b65b3815ab12935dc0edd061eedb66c077f" exitCode=0 Oct 30 14:15:01.685800 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:01.685730 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" event={"ID":"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6","Type":"ContainerDied","Data":"7c333995935d110f677fcd4ff4ba8b65b3815ab12935dc0edd061eedb66c077f"} Oct 30 14:15:01.844787 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:15:01.844742 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:15:02.692567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.692519 5768 generic.go:356] "Generic (PLEG): container finished" podID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerID="d6db51a1786dd69f112e5cbaff92f29af3affa0e06b7b04287040918261960e2" exitCode=0 Oct 30 14:15:02.692955 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.692606 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" event={"ID":"ba37f2e5-e660-4ba5-af1f-197289a81a96","Type":"ContainerDied","Data":"d6db51a1786dd69f112e5cbaff92f29af3affa0e06b7b04287040918261960e2"} Oct 30 14:15:02.838951 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.838922 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:15:02.841865 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.841847 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:15:02.917391 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917358 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\") pod \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " Oct 30 14:15:02.917603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917403 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\" (UniqueName: \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\") pod \"bd1252f5-6052-4461-b47e-a53dcfabe04b\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " Oct 30 14:15:02.917603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917484 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\") pod \"bd1252f5-6052-4461-b47e-a53dcfabe04b\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " Oct 30 14:15:02.917603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917511 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\" (UniqueName: \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\") pod \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " Oct 30 14:15:02.917603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917542 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\") pod \"bd1252f5-6052-4461-b47e-a53dcfabe04b\" (UID: \"bd1252f5-6052-4461-b47e-a53dcfabe04b\") " Oct 30 14:15:02.917603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.917588 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\") pod \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\" (UID: \"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6\") " Oct 30 14:15:02.918105 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.918076 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle" pod "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" (UID: "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:02.918224 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.918127 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle" pod "bd1252f5-6052-4461-b47e-a53dcfabe04b" (UID: "bd1252f5-6052-4461-b47e-a53dcfabe04b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:02.920175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.920150 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh" pod "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" (UID: "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6"). InnerVolumeSpecName "kube-api-access-2z5dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:15:02.920175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.920162 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv" pod "bd1252f5-6052-4461-b47e-a53dcfabe04b" (UID: "bd1252f5-6052-4461-b47e-a53dcfabe04b"). InnerVolumeSpecName "kube-api-access-7njgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:15:02.924213 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.924166 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util" pod "bd1252f5-6052-4461-b47e-a53dcfabe04b" (UID: "bd1252f5-6052-4461-b47e-a53dcfabe04b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:02.924775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:02.924756 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util" pod "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" (UID: "64c9fd9c-216d-4b6e-8b01-85d695e7d1e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018261 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018301 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z5dh\" (UniqueName: \"kubernetes.io/projected/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-kube-api-access-2z5dh\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018313 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd1252f5-6052-4461-b47e-a53dcfabe04b-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018322 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018329 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c9fd9c-216d-4b6e-8b01-85d695e7d1e6-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.018351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.018338 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7njgv\" (UniqueName: \"kubernetes.io/projected/bd1252f5-6052-4461-b47e-a53dcfabe04b-kube-api-access-7njgv\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:03.699028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.698987 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" event={"ID":"64c9fd9c-216d-4b6e-8b01-85d695e7d1e6","Type":"ContainerDied","Data":"63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1"} Oct 30 14:15:03.699511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.699049 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63cd493acbecb473930e4b34232d357741d3102bc3a7b18c07163351e11a22b1" Oct 30 14:15:03.699511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.699008 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czsmkh" Oct 30 14:15:03.700941 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.700916 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" event={"ID":"bd1252f5-6052-4461-b47e-a53dcfabe04b","Type":"ContainerDied","Data":"11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3"} Oct 30 14:15:03.701075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.700945 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dj8tl" Oct 30 14:15:03.701075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.700956 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11036259bdac4d4f4592d533910fab5587be8333a9955c6214e852b20525bad3" Oct 30 14:15:03.820398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.820367 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:15:03.926908 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.926869 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\" (UniqueName: \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\") pod \"ba37f2e5-e660-4ba5-af1f-197289a81a96\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " Oct 30 14:15:03.927101 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.926926 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\") pod \"ba37f2e5-e660-4ba5-af1f-197289a81a96\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " Oct 30 14:15:03.927101 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.927065 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\") pod \"ba37f2e5-e660-4ba5-af1f-197289a81a96\" (UID: \"ba37f2e5-e660-4ba5-af1f-197289a81a96\") " Oct 30 14:15:03.927860 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.927811 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle" pod "ba37f2e5-e660-4ba5-af1f-197289a81a96" (UID: "ba37f2e5-e660-4ba5-af1f-197289a81a96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:03.929284 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.929260 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5" pod "ba37f2e5-e660-4ba5-af1f-197289a81a96" (UID: "ba37f2e5-e660-4ba5-af1f-197289a81a96"). InnerVolumeSpecName "kube-api-access-rgfl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:15:03.932381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:03.932355 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util" pod "ba37f2e5-e660-4ba5-af1f-197289a81a96" (UID: "ba37f2e5-e660-4ba5-af1f-197289a81a96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:04.027770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.027698 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgfl5\" (UniqueName: \"kubernetes.io/projected/ba37f2e5-e660-4ba5-af1f-197289a81a96-kube-api-access-rgfl5\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:04.027770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.027724 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:04.027770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.027734 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba37f2e5-e660-4ba5-af1f-197289a81a96-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:04.707352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.707328 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" Oct 30 14:15:04.707352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.707346 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar86hq" event={"ID":"ba37f2e5-e660-4ba5-af1f-197289a81a96","Type":"ContainerDied","Data":"7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40"} Oct 30 14:15:04.707802 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:04.707384 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cdd4c936189f242c877ba50fe9af8229ad5fef2b2eb795f45d6fc77709d2f40" Oct 30 14:15:11.746281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:11.746242 5768 generic.go:356] "Generic (PLEG): container finished" podID="927a9f72-3acf-4597-8917-8c316d5e8046" containerID="aa5fb964b03aa075b4aee920a4f1e333f8aa0c2b54a45fe2eebd1e77bfe9fc62" exitCode=0 Oct 30 14:15:11.746661 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:11.746282 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" event={"ID":"927a9f72-3acf-4597-8917-8c316d5e8046","Type":"ContainerDied","Data":"aa5fb964b03aa075b4aee920a4f1e333f8aa0c2b54a45fe2eebd1e77bfe9fc62"} Oct 30 14:15:12.753615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:12.753582 5768 generic.go:356] "Generic (PLEG): container finished" podID="927a9f72-3acf-4597-8917-8c316d5e8046" containerID="fdfb74d65869a2b9377384e5f52fc5088e9f9c5e4ae4f5f6ebc9d7cf1646acdc" exitCode=0 Oct 30 14:15:12.753989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:12.753623 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" event={"ID":"927a9f72-3acf-4597-8917-8c316d5e8046","Type":"ContainerDied","Data":"fdfb74d65869a2b9377384e5f52fc5088e9f9c5e4ae4f5f6ebc9d7cf1646acdc"} Oct 30 14:15:13.881030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:13.881006 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:15:14.016433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.016351 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\" (UniqueName: \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\") pod \"927a9f72-3acf-4597-8917-8c316d5e8046\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " Oct 30 14:15:14.016433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.016386 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\") pod \"927a9f72-3acf-4597-8917-8c316d5e8046\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " Oct 30 14:15:14.016433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.016410 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\") pod \"927a9f72-3acf-4597-8917-8c316d5e8046\" (UID: \"927a9f72-3acf-4597-8917-8c316d5e8046\") " Oct 30 14:15:14.016967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.016939 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle" pod "927a9f72-3acf-4597-8917-8c316d5e8046" (UID: "927a9f72-3acf-4597-8917-8c316d5e8046"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:14.018799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.018772 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq" pod "927a9f72-3acf-4597-8917-8c316d5e8046" (UID: "927a9f72-3acf-4597-8917-8c316d5e8046"). InnerVolumeSpecName "kube-api-access-9xzgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:15:14.020716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.020694 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util" pod "927a9f72-3acf-4597-8917-8c316d5e8046" (UID: "927a9f72-3acf-4597-8917-8c316d5e8046"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:15:14.117283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.117236 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xzgq\" (UniqueName: \"kubernetes.io/projected/927a9f72-3acf-4597-8917-8c316d5e8046-kube-api-access-9xzgq\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:14.117283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.117279 5768 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-util\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:14.117283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.117290 5768 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/927a9f72-3acf-4597-8917-8c316d5e8046-bundle\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:15:14.764757 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.764721 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" event={"ID":"927a9f72-3acf-4597-8917-8c316d5e8046","Type":"ContainerDied","Data":"c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396"} Oct 30 14:15:14.764939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.764776 5768 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c62fac9eba145447c412315225d4305b4ab759504c45ae5d5ec8b2a7a6663396" Oct 30 14:15:14.764939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:14.764775 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7d4rm5" Oct 30 14:15:21.095379 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:21.095346 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:21.887265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:21.887232 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:25.095363 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:25.095316 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:25.425257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:25.425223 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:26.820699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:26.820660 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:27.513656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:27.513618 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:28.141750 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:28.141720 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:29.498231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:29.498196 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:29.890332 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:29.890245 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:30.291004 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:30.290968 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:30.751104 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:30.751068 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:30.915116 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:30.915082 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:31.846403 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:15:31.846357 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:15:32.438797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:32.438762 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:34.902409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:34.902378 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:35.053445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:35.053412 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:35.509896 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:35.509855 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:35.659053 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:35.659012 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:37.900897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:37.900855 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:38.052852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:38.052809 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:40.843302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843248 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g"] Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843631 5768 cpu_manager.go:414] "containerMap: removing container" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843643 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843652 5768 cpu_manager.go:414] "containerMap: removing container" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843659 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843670 5768 cpu_manager.go:414] "containerMap: removing container" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="pull" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843675 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="pull" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843683 5768 cpu_manager.go:414] "containerMap: removing container" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843687 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843693 5768 cpu_manager.go:414] "containerMap: removing container" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843698 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843708 5768 cpu_manager.go:414] "containerMap: removing container" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843712 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="extract" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843719 5768 cpu_manager.go:414] "containerMap: removing container" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843723 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="util" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843728 5768 cpu_manager.go:414] "containerMap: removing container" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="pull" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843732 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="pull" Oct 30 14:15:40.843732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843741 5768 cpu_manager.go:414] "containerMap: removing container" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="pull" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843745 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="pull" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843756 5768 cpu_manager.go:414] "containerMap: removing container" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="util" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843760 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="util" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843766 5768 cpu_manager.go:414] "containerMap: removing container" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="pull" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843771 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="pull" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843776 5768 cpu_manager.go:414] "containerMap: removing container" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="extract" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843780 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="extract" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843836 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="927a9f72-3acf-4597-8917-8c316d5e8046" containerName="extract" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843843 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba37f2e5-e660-4ba5-af1f-197289a81a96" containerName="extract" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843851 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd1252f5-6052-4461-b47e-a53dcfabe04b" containerName="extract" Oct 30 14:15:40.844454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.843859 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="64c9fd9c-216d-4b6e-8b01-85d695e7d1e6" containerName="extract" Oct 30 14:15:40.846728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.846712 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:40.873643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.873615 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Oct 30 14:15:40.873643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.873640 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Oct 30 14:15:40.873840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.873679 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bn8rh\"" Oct 30 14:15:40.873840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.873680 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 14:15:40.873840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.873681 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 14:15:40.875405 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.875385 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g"] Oct 30 14:15:40.881804 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.881766 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:40.955199 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.955165 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/200b89d1-dfac-4f00-b8a9-6f764ef674df-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:40.955375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.955208 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/200b89d1-dfac-4f00-b8a9-6f764ef674df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:40.955375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:40.955301 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnh6z\" (UniqueName: \"kubernetes.io/projected/200b89d1-dfac-4f00-b8a9-6f764ef674df-kube-api-access-pnh6z\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.056401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.056359 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnh6z\" (UniqueName: \"kubernetes.io/projected/200b89d1-dfac-4f00-b8a9-6f764ef674df-kube-api-access-pnh6z\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.056615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.056446 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/200b89d1-dfac-4f00-b8a9-6f764ef674df-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.056615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.056475 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/200b89d1-dfac-4f00-b8a9-6f764ef674df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.057237 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.057216 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/200b89d1-dfac-4f00-b8a9-6f764ef674df-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.059043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.059024 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/200b89d1-dfac-4f00-b8a9-6f764ef674df-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.075797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.075771 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:41.080314 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.080294 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnh6z\" (UniqueName: \"kubernetes.io/projected/200b89d1-dfac-4f00-b8a9-6f764ef674df-kube-api-access-pnh6z\") pod \"kuadrant-console-plugin-66c4fb575d-vvm7g\" (UID: \"200b89d1-dfac-4f00-b8a9-6f764ef674df\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.157567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.157466 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" Oct 30 14:15:41.457131 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.457095 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g"] Oct 30 14:15:41.461734 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:15:41.461706 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod200b89d1_dfac_4f00_b8a9_6f764ef674df.slice/crio-9af2ecc13a9d2a4b06f7fec47132bf2804bcd2aa2c97cc2aec1f7a928b6591be WatchSource:0}: Error finding container 9af2ecc13a9d2a4b06f7fec47132bf2804bcd2aa2c97cc2aec1f7a928b6591be: Status 404 returned error can't find the container with id 9af2ecc13a9d2a4b06f7fec47132bf2804bcd2aa2c97cc2aec1f7a928b6591be Oct 30 14:15:41.887317 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:41.887240 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" event={"ID":"200b89d1-dfac-4f00-b8a9-6f764ef674df","Type":"ContainerStarted","Data":"9af2ecc13a9d2a4b06f7fec47132bf2804bcd2aa2c97cc2aec1f7a928b6591be"} Oct 30 14:15:42.117465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:42.117371 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:42.270928 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:42.270887 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:45.910527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:45.910487 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" event={"ID":"200b89d1-dfac-4f00-b8a9-6f764ef674df","Type":"ContainerStarted","Data":"f0292cf8c371106e1cde52b8a904c2667b1885d2085dc03536269723b415853a"} Oct 30 14:15:45.955660 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:45.955571 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vvm7g" podStartSLOduration=1.7205345840000001 podStartE2EDuration="5.955538891s" totalImagesPullingTime="4.235004307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:15:45.954732201 +0000 UTC m=+497.293531211" watchObservedRunningTime="2026-10-30 14:15:45.955538891 +0000 UTC m=+497.294337901" Oct 30 14:15:46.924062 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:46.924028 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:47.089926 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:47.089888 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:55.631939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:55.631893 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:56.970885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:56.970854 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:57.133305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:57.133262 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:57.281148 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:57.281064 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:57.560089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:57.559994 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:15:57.711898 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:15:57.711862 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:00.962776 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:00.962743 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:01.125830 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:01.125794 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:01.844266 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:16:01.844231 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:16:05.253257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:05.253226 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:05.434254 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:05.434219 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:09.772753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:09.772712 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:09.914302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:09.914254 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:13.177862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:13.177819 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:13.327426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:13.327381 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:13.969148 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:13.969113 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:15.794484 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:15.794444 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:15.955398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:15.955362 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:22.171196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:22.171160 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:22.327710 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:22.327678 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:31.844391 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:16:31.844354 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:16:35.545191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.545160 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:35.548726 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.548707 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.564121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.564093 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 30 14:16:35.564396 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.564378 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:35.572464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.572436 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:35.643349 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.643316 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lzv\" (UniqueName: \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.643527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.643470 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.685609 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.685579 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:35.715296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.715259 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:35.744591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.744541 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.744719 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.744611 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lzv\" (UniqueName: \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.745229 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.745213 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.768767 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.768739 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lzv\" (UniqueName: \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\") pod \"limitador-limitador-74dfcfb894-2fm85\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.861744 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.861656 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:35.867824 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:35.867784 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:36.159992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.159914 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:36.164821 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:16:36.164793 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e35fd5_5afc_4370_8b62_970639f7cf2d.slice/crio-991b6dd2954687111cc2c7e033d75a72b015d050be893c25e4cf233c7520c7ec WatchSource:0}: Error finding container 991b6dd2954687111cc2c7e033d75a72b015d050be893c25e4cf233c7520c7ec: Status 404 returned error can't find the container with id 991b6dd2954687111cc2c7e033d75a72b015d050be893c25e4cf233c7520c7ec Oct 30 14:16:36.454891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.454854 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:36.459530 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.459508 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:36.478262 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.478241 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:36.480627 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.480610 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qbtcr\"" Oct 30 14:16:36.551637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.551605 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-472gw\" (UniqueName: \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\") pod \"authorino-57f7f8659f-wt2gf\" (UID: \"3f09243f-b5a3-4cf8-a851-0aef2009cdf5\") " pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:36.567969 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.567934 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:36.652280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.652246 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-472gw\" (UniqueName: \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\") pod \"authorino-57f7f8659f-wt2gf\" (UID: \"3f09243f-b5a3-4cf8-a851-0aef2009cdf5\") " pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:36.676048 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.676017 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-472gw\" (UniqueName: \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\") pod \"authorino-57f7f8659f-wt2gf\" (UID: \"3f09243f-b5a3-4cf8-a851-0aef2009cdf5\") " pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:36.771490 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:36.771406 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:37.028762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.028692 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:16:37.033122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.033096 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:16:37.053709 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.051447 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:16:37.068979 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.068944 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:37.074148 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:16:37.074121 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f09243f_b5a3_4cf8_a851_0aef2009cdf5.slice/crio-1b19d27d7f890395606f749a5102fb82eeaa5c21ba41ae1baae5b240deffabb1 WatchSource:0}: Error finding container 1b19d27d7f890395606f749a5102fb82eeaa5c21ba41ae1baae5b240deffabb1: Status 404 returned error can't find the container with id 1b19d27d7f890395606f749a5102fb82eeaa5c21ba41ae1baae5b240deffabb1 Oct 30 14:16:37.139393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.139356 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" event={"ID":"f5e35fd5-5afc-4370-8b62-970639f7cf2d","Type":"ContainerStarted","Data":"991b6dd2954687111cc2c7e033d75a72b015d050be893c25e4cf233c7520c7ec"} Oct 30 14:16:37.141177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.141145 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" event={"ID":"3f09243f-b5a3-4cf8-a851-0aef2009cdf5","Type":"ContainerStarted","Data":"1b19d27d7f890395606f749a5102fb82eeaa5c21ba41ae1baae5b240deffabb1"} Oct 30 14:16:37.157765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.157731 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5tmj\" (UniqueName: \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\") pod \"authorino-56c6c9ddd5-4kf78\" (UID: \"6e59eac4-6c89-433d-9869-ccacf3c6bd1c\") " pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:16:37.258597 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.258535 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5tmj\" (UniqueName: \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\") pod \"authorino-56c6c9ddd5-4kf78\" (UID: \"6e59eac4-6c89-433d-9869-ccacf3c6bd1c\") " pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:16:37.283304 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.283230 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5tmj\" (UniqueName: \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\") pod \"authorino-56c6c9ddd5-4kf78\" (UID: \"6e59eac4-6c89-433d-9869-ccacf3c6bd1c\") " pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:16:37.355964 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.355926 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:16:37.666350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:37.666295 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:16:37.671248 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:16:37.671218 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e59eac4_6c89_433d_9869_ccacf3c6bd1c.slice/crio-b0aa9b690be0763582de71c5b1418f6c586f057e26f8bf709165c5662ca22832 WatchSource:0}: Error finding container b0aa9b690be0763582de71c5b1418f6c586f057e26f8bf709165c5662ca22832: Status 404 returned error can't find the container with id b0aa9b690be0763582de71c5b1418f6c586f057e26f8bf709165c5662ca22832 Oct 30 14:16:38.049725 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:38.049582 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:38.156589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:38.156532 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" event={"ID":"6e59eac4-6c89-433d-9869-ccacf3c6bd1c","Type":"ContainerStarted","Data":"b0aa9b690be0763582de71c5b1418f6c586f057e26f8bf709165c5662ca22832"} Oct 30 14:16:40.171065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.171025 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" event={"ID":"f5e35fd5-5afc-4370-8b62-970639f7cf2d","Type":"ContainerStarted","Data":"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98"} Oct 30 14:16:40.171498 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.171183 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:40.172492 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.172472 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" event={"ID":"3f09243f-b5a3-4cf8-a851-0aef2009cdf5","Type":"ContainerStarted","Data":"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350"} Oct 30 14:16:40.173937 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.173918 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" event={"ID":"6e59eac4-6c89-433d-9869-ccacf3c6bd1c","Type":"ContainerStarted","Data":"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8"} Oct 30 14:16:40.214139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.214101 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" podStartSLOduration=2.217803148 podStartE2EDuration="5.214088575s" totalImagesPullingTime="2.996285427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:16:40.212325825 +0000 UTC m=+551.551124835" watchObservedRunningTime="2026-10-30 14:16:40.214088575 +0000 UTC m=+551.552887584" Oct 30 14:16:40.251123 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.251078 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" podStartSLOduration=1.20119013 podStartE2EDuration="3.251067037s" totalImagesPullingTime="2.049876907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:16:40.250938406 +0000 UTC m=+551.589737416" watchObservedRunningTime="2026-10-30 14:16:40.251067037 +0000 UTC m=+551.589866075" Oct 30 14:16:40.276477 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.276450 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:40.290505 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:40.290458 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" podStartSLOduration=1.633980036 podStartE2EDuration="4.29044342s" totalImagesPullingTime="2.656463384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:16:40.289401098 +0000 UTC m=+551.628200117" watchObservedRunningTime="2026-10-30 14:16:40.29044342 +0000 UTC m=+551.629242430" Oct 30 14:16:42.183654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:42.183617 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" podUID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" containerName="authorino" containerID="cri-o://d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350" gracePeriod=30 Oct 30 14:16:42.425003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:42.424978 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:42.511236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:42.511151 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\" (UniqueName: \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\") pod \"3f09243f-b5a3-4cf8-a851-0aef2009cdf5\" (UID: \"3f09243f-b5a3-4cf8-a851-0aef2009cdf5\") " Oct 30 14:16:42.513487 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:42.513461 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw" pod "3f09243f-b5a3-4cf8-a851-0aef2009cdf5" (UID: "3f09243f-b5a3-4cf8-a851-0aef2009cdf5"). InnerVolumeSpecName "kube-api-access-472gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:16:42.611983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:42.611948 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-472gw\" (UniqueName: \"kubernetes.io/projected/3f09243f-b5a3-4cf8-a851-0aef2009cdf5-kube-api-access-472gw\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:16:43.189105 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.189068 5768 generic.go:356] "Generic (PLEG): container finished" podID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" containerID="d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350" exitCode=0 Oct 30 14:16:43.189567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.189117 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" Oct 30 14:16:43.189567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.189132 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" event={"ID":"3f09243f-b5a3-4cf8-a851-0aef2009cdf5","Type":"ContainerDied","Data":"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350"} Oct 30 14:16:43.189567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.189171 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-wt2gf" event={"ID":"3f09243f-b5a3-4cf8-a851-0aef2009cdf5","Type":"ContainerDied","Data":"1b19d27d7f890395606f749a5102fb82eeaa5c21ba41ae1baae5b240deffabb1"} Oct 30 14:16:43.189567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.189192 5768 scope.go:122] "RemoveContainer" containerID="d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350" Oct 30 14:16:43.197684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.197663 5768 scope.go:122] "RemoveContainer" containerID="d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350" Oct 30 14:16:43.197978 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:16:43.197954 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350\": container with ID starting with d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350 not found: ID does not exist" containerID="d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350" Oct 30 14:16:43.198022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.197988 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350"} err="failed to get container status \"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350\": rpc error: code = NotFound desc = could not find container \"d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350\": container with ID starting with d444ca38863253ca84404a2aaa839d0da10ac0d8a046f2a9f1c925bf22d07350 not found: ID does not exist" Oct 30 14:16:43.240452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.240424 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:43.252420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:43.252396 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-wt2gf"] Oct 30 14:16:44.781640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:44.781607 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" path="/var/lib/kubelet/pods/3f09243f-b5a3-4cf8-a851-0aef2009cdf5/volumes" Oct 30 14:16:50.105056 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.105019 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:50.105692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.105244 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" podUID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" containerName="limitador" containerID="cri-o://971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98" gracePeriod=30 Oct 30 14:16:50.107065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.107043 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:50.645111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.645090 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:50.682353 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.682285 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\" (UniqueName: \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\") pod \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " Oct 30 14:16:50.682647 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.682626 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file" pod "f5e35fd5-5afc-4370-8b62-970639f7cf2d" (UID: "f5e35fd5-5afc-4370-8b62-970639f7cf2d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:16:50.782920 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.782889 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\" (UniqueName: \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\") pod \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\" (UID: \"f5e35fd5-5afc-4370-8b62-970639f7cf2d\") " Oct 30 14:16:50.783095 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.783077 5768 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f5e35fd5-5afc-4370-8b62-970639f7cf2d-config-file\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:16:50.785056 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.785033 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv" pod "f5e35fd5-5afc-4370-8b62-970639f7cf2d" (UID: "f5e35fd5-5afc-4370-8b62-970639f7cf2d"). InnerVolumeSpecName "kube-api-access-q4lzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:16:50.883878 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:50.883840 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4lzv\" (UniqueName: \"kubernetes.io/projected/f5e35fd5-5afc-4370-8b62-970639f7cf2d-kube-api-access-q4lzv\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:16:51.229113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.229081 5768 generic.go:356] "Generic (PLEG): container finished" podID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" containerID="971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98" exitCode=0 Oct 30 14:16:51.229578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.229128 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" Oct 30 14:16:51.229578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.229176 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" event={"ID":"f5e35fd5-5afc-4370-8b62-970639f7cf2d","Type":"ContainerDied","Data":"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98"} Oct 30 14:16:51.229578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.229233 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-2fm85" event={"ID":"f5e35fd5-5afc-4370-8b62-970639f7cf2d","Type":"ContainerDied","Data":"991b6dd2954687111cc2c7e033d75a72b015d050be893c25e4cf233c7520c7ec"} Oct 30 14:16:51.229578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.229255 5768 scope.go:122] "RemoveContainer" containerID="971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98" Oct 30 14:16:51.237971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.237951 5768 scope.go:122] "RemoveContainer" containerID="971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98" Oct 30 14:16:51.238247 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:16:51.238227 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98\": container with ID starting with 971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98 not found: ID does not exist" containerID="971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98" Oct 30 14:16:51.238318 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.238255 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98"} err="failed to get container status \"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98\": rpc error: code = NotFound desc = could not find container \"971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98\": container with ID starting with 971372a068bbce833deb80c3f62e951d7a68f03b0163590398a17193c072de98 not found: ID does not exist" Oct 30 14:16:51.281388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.281364 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:51.293139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:51.293112 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-2fm85"] Oct 30 14:16:52.162770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.162740 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:52.310042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.310008 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:52.782154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.782113 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" path="/var/lib/kubelet/pods/f5e35fd5-5afc-4370-8b62-970639f7cf2d/volumes" Oct 30 14:16:52.842425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.842394 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n"] Oct 30 14:16:52.842948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.842915 5768 cpu_manager.go:414] "containerMap: removing container" podUID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" containerName="limitador" Oct 30 14:16:52.842948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.842942 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" containerName="limitador" Oct 30 14:16:52.843291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.842967 5768 cpu_manager.go:414] "containerMap: removing container" podUID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" containerName="authorino" Oct 30 14:16:52.843291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.842974 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" containerName="authorino" Oct 30 14:16:52.843291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.843089 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5e35fd5-5afc-4370-8b62-970639f7cf2d" containerName="limitador" Oct 30 14:16:52.843291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.843103 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f09243f-b5a3-4cf8-a851-0aef2009cdf5" containerName="authorino" Oct 30 14:16:52.847766 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.847750 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:52.867171 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.867140 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n"] Oct 30 14:16:52.877642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.877621 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 14:16:52.877842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.877826 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 14:16:52.877924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.877908 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7l79r\"" Oct 30 14:16:52.877924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.877911 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Oct 30 14:16:52.897364 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.897331 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw7x2\" (UniqueName: \"kubernetes.io/projected/76b43768-28e3-42d6-b723-052aae311863-kube-api-access-pw7x2\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:52.897520 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.897460 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/76b43768-28e3-42d6-b723-052aae311863-data\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:52.997833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.997799 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw7x2\" (UniqueName: \"kubernetes.io/projected/76b43768-28e3-42d6-b723-052aae311863-kube-api-access-pw7x2\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:52.998028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.997860 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/76b43768-28e3-42d6-b723-052aae311863-data\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:52.998198 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:52.998184 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/76b43768-28e3-42d6-b723-052aae311863-data\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:53.030799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:53.030768 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw7x2\" (UniqueName: \"kubernetes.io/projected/76b43768-28e3-42d6-b723-052aae311863-kube-api-access-pw7x2\") pod \"postgres-7cdbf6dc44-7bw4n\" (UID: \"76b43768-28e3-42d6-b723-052aae311863\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:53.104240 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:53.104147 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:16:53.160880 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:53.160838 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:53.458536 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:53.458499 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n"] Oct 30 14:16:53.462853 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:16:53.462824 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b43768_28e3_42d6_b723_052aae311863.slice/crio-26e0c5985ffd692a55427164e947f1c175130f4fc56f4154a07690c79e763d90 WatchSource:0}: Error finding container 26e0c5985ffd692a55427164e947f1c175130f4fc56f4154a07690c79e763d90: Status 404 returned error can't find the container with id 26e0c5985ffd692a55427164e947f1c175130f4fc56f4154a07690c79e763d90 Oct 30 14:16:54.248430 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:54.248393 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" event={"ID":"76b43768-28e3-42d6-b723-052aae311863","Type":"ContainerStarted","Data":"26e0c5985ffd692a55427164e947f1c175130f4fc56f4154a07690c79e763d90"} Oct 30 14:16:58.272279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:58.272242 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" event={"ID":"76b43768-28e3-42d6-b723-052aae311863","Type":"ContainerStarted","Data":"c9bbae74269e2073413e12a4c9c250023276fe1f87e72d12f711138335a6ca0c"} Oct 30 14:16:58.272773 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:58.272351 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:16:58.314591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:16:58.314468 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" podStartSLOduration=1.740346116 podStartE2EDuration="6.314449812s" totalImagesPullingTime="4.574103696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:16:58.313166299 +0000 UTC m=+569.651965309" watchObservedRunningTime="2026-10-30 14:16:58.314449812 +0000 UTC m=+569.653248857" Oct 30 14:17:01.844222 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:01.844185 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:17:04.306101 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:04.306071 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7bw4n" Oct 30 14:17:04.826826 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:04.826794 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:04.987110 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:04.987077 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:05.125880 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.125801 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-fnh77"] Oct 30 14:17:05.129113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.129095 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:05.151722 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.151702 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-fnh77"] Oct 30 14:17:05.212838 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.212809 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzrtm\" (UniqueName: \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\") pod \"authorino-6f6944bcdd-fnh77\" (UID: \"b80e713d-3c9b-48b0-979e-7cf7dce1aa7c\") " pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:05.314017 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.313986 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzrtm\" (UniqueName: \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\") pod \"authorino-6f6944bcdd-fnh77\" (UID: \"b80e713d-3c9b-48b0-979e-7cf7dce1aa7c\") " pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:05.338208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.338179 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-fnh77"] Oct 30 14:17:05.338397 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:05.338375 5768 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vzrtm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-fnh77" podUID="b80e713d-3c9b-48b0-979e-7cf7dce1aa7c" Oct 30 14:17:05.341657 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.341635 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzrtm\" (UniqueName: \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\") pod \"authorino-6f6944bcdd-fnh77\" (UID: \"b80e713d-3c9b-48b0-979e-7cf7dce1aa7c\") " pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:05.370323 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.370303 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-jjv5s"] Oct 30 14:17:05.372811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.372795 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.388376 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.388358 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 30 14:17:05.396787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.396768 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-jjv5s"] Oct 30 14:17:05.415110 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.415083 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6mc\" (UniqueName: \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.415215 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.415135 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.493236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.493196 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-jjv5s"] Oct 30 14:17:05.493405 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:05.493388 5768 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jf6mc tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" podUID="f82bbc37-fd46-48bc-93ad-4b2ebd711099" Oct 30 14:17:05.515895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.515867 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6mc\" (UniqueName: \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.516015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.515919 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.518540 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.518512 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.538903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.538878 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:17:05.543967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.543392 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.547024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.547002 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6mc\" (UniqueName: \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\") pod \"authorino-6889cbd8c4-jjv5s\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:05.564331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.564310 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:17:05.617084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.617055 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.617224 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.617112 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6b9\" (UniqueName: \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.718060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.718030 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6b9\" (UniqueName: \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.718193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.718100 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.720760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.720740 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.741894 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.741863 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6b9\" (UniqueName: \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\") pod \"authorino-568bd4bb5f-4gtft\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:05.861300 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:05.861271 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:17:06.157967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.157888 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:17:06.162491 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:17:06.162465 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2487a6e_d968_40d1_8cc9_b4174383decf.slice/crio-abdfcbc5628c04783eb818640d12baf84ebbec8af1abc7c694a29149252f8c61 WatchSource:0}: Error finding container abdfcbc5628c04783eb818640d12baf84ebbec8af1abc7c694a29149252f8c61: Status 404 returned error can't find the container with id abdfcbc5628c04783eb818640d12baf84ebbec8af1abc7c694a29149252f8c61 Oct 30 14:17:06.312430 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.312385 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" event={"ID":"d2487a6e-d968-40d1-8cc9-b4174383decf","Type":"ContainerStarted","Data":"abdfcbc5628c04783eb818640d12baf84ebbec8af1abc7c694a29149252f8c61"} Oct 30 14:17:06.312629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.312434 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:06.312629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.312434 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:06.319150 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.319129 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:06.321987 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.321970 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:06.423988 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.423965 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\" (UniqueName: \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\") pod \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " Oct 30 14:17:06.424182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.423997 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\" (UniqueName: \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\") pod \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\" (UID: \"f82bbc37-fd46-48bc-93ad-4b2ebd711099\") " Oct 30 14:17:06.424182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.424021 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\" (UniqueName: \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\") pod \"b80e713d-3c9b-48b0-979e-7cf7dce1aa7c\" (UID: \"b80e713d-3c9b-48b0-979e-7cf7dce1aa7c\") " Oct 30 14:17:06.426294 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.426266 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc" pod "f82bbc37-fd46-48bc-93ad-4b2ebd711099" (UID: "f82bbc37-fd46-48bc-93ad-4b2ebd711099"). InnerVolumeSpecName "kube-api-access-jf6mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:17:06.426397 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.426290 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert" pod "f82bbc37-fd46-48bc-93ad-4b2ebd711099" (UID: "f82bbc37-fd46-48bc-93ad-4b2ebd711099"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:17:06.426397 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.426315 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm" pod "b80e713d-3c9b-48b0-979e-7cf7dce1aa7c" (UID: "b80e713d-3c9b-48b0-979e-7cf7dce1aa7c"). InnerVolumeSpecName "kube-api-access-vzrtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:17:06.525156 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.525133 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf6mc\" (UniqueName: \"kubernetes.io/projected/f82bbc37-fd46-48bc-93ad-4b2ebd711099-kube-api-access-jf6mc\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:06.525156 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.525156 5768 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f82bbc37-fd46-48bc-93ad-4b2ebd711099-tls-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:06.525296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:06.525167 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzrtm\" (UniqueName: \"kubernetes.io/projected/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c-kube-api-access-vzrtm\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:07.319279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.319245 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" event={"ID":"d2487a6e-d968-40d1-8cc9-b4174383decf","Type":"ContainerStarted","Data":"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047"} Oct 30 14:17:07.319784 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.319367 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-jjv5s" Oct 30 14:17:07.319784 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.319576 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-fnh77" Oct 30 14:17:07.365453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.365407 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" podStartSLOduration=2.02706984 podStartE2EDuration="2.365393774s" totalImagesPullingTime="338.323934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:17:07.364310114 +0000 UTC m=+578.703109123" watchObservedRunningTime="2026-10-30 14:17:07.365393774 +0000 UTC m=+578.704193189" Oct 30 14:17:07.397511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.397479 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:17:07.397936 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.397897 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" podUID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" containerName="authorino" containerID="cri-o://14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8" gracePeriod=30 Oct 30 14:17:07.434205 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.434175 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-fnh77"] Oct 30 14:17:07.436696 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.436671 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-fnh77"] Oct 30 14:17:07.499642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.499597 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-jjv5s"] Oct 30 14:17:07.506502 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.506470 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-jjv5s"] Oct 30 14:17:07.691800 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.691774 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:17:07.736230 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.736201 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\" (UniqueName: \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\") pod \"6e59eac4-6c89-433d-9869-ccacf3c6bd1c\" (UID: \"6e59eac4-6c89-433d-9869-ccacf3c6bd1c\") " Oct 30 14:17:07.738531 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.738504 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj" pod "6e59eac4-6c89-433d-9869-ccacf3c6bd1c" (UID: "6e59eac4-6c89-433d-9869-ccacf3c6bd1c"). InnerVolumeSpecName "kube-api-access-w5tmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:17:07.837470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:07.837432 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5tmj\" (UniqueName: \"kubernetes.io/projected/6e59eac4-6c89-433d-9869-ccacf3c6bd1c-kube-api-access-w5tmj\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:08.326394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.326352 5768 generic.go:356] "Generic (PLEG): container finished" podID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" containerID="14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8" exitCode=0 Oct 30 14:17:08.326842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.326431 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" event={"ID":"6e59eac4-6c89-433d-9869-ccacf3c6bd1c","Type":"ContainerDied","Data":"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8"} Oct 30 14:17:08.326842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.326455 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" Oct 30 14:17:08.326842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.326480 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-4kf78" event={"ID":"6e59eac4-6c89-433d-9869-ccacf3c6bd1c","Type":"ContainerDied","Data":"b0aa9b690be0763582de71c5b1418f6c586f057e26f8bf709165c5662ca22832"} Oct 30 14:17:08.326842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.326499 5768 scope.go:122] "RemoveContainer" containerID="14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8" Oct 30 14:17:08.336615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.336594 5768 scope.go:122] "RemoveContainer" containerID="14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8" Oct 30 14:17:08.336903 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:08.336885 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8\": container with ID starting with 14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8 not found: ID does not exist" containerID="14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8" Oct 30 14:17:08.336981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.336917 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8"} err="failed to get container status \"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8\": rpc error: code = NotFound desc = could not find container \"14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8\": container with ID starting with 14635b7c7ea106f5e864eb6b467adab52ceea387efad46d1404b703f9aafb6c8 not found: ID does not exist" Oct 30 14:17:08.382296 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.382267 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:17:08.387188 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.387166 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-4kf78"] Oct 30 14:17:08.782157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.782120 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" path="/var/lib/kubelet/pods/6e59eac4-6c89-433d-9869-ccacf3c6bd1c/volumes" Oct 30 14:17:08.782643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.782627 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b80e713d-3c9b-48b0-979e-7cf7dce1aa7c" path="/var/lib/kubelet/pods/b80e713d-3c9b-48b0-979e-7cf7dce1aa7c/volumes" Oct 30 14:17:08.782972 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:08.782959 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f82bbc37-fd46-48bc-93ad-4b2ebd711099" path="/var/lib/kubelet/pods/f82bbc37-fd46-48bc-93ad-4b2ebd711099/volumes" Oct 30 14:17:14.540788 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.540752 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:14.560959 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.560926 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:14.561302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.561287 5768 cpu_manager.go:414] "containerMap: removing container" podUID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" containerName="authorino" Oct 30 14:17:14.561394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.561304 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" containerName="authorino" Oct 30 14:17:14.561394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.561382 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e59eac4-6c89-433d-9869-ccacf3c6bd1c" containerName="authorino" Oct 30 14:17:14.564733 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.564712 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.580405 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.580383 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqcqr\"" Oct 30 14:17:14.592437 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.592418 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 30 14:17:14.592570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.592433 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 30 14:17:14.592570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.592472 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 30 14:17:14.596107 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.596086 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:14.689280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.689237 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:14.700316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.700291 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.700461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.700361 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbtl7\" (UniqueName: \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.700534 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.700477 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.801573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.801489 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.801573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.801567 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbtl7\" (UniqueName: \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.801778 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.801594 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.804072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.804047 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.804162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.804075 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.826273 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.826244 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbtl7\" (UniqueName: \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\") pod \"maas-controller-577f596567-w4wzs\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.836945 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.836911 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:14.877900 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.877877 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:14.907938 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.907910 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:17:14.911589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.911571 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:14.938630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:14.938597 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:17:15.003280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.003251 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.003427 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.003386 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.003427 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.003407 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6nd\" (UniqueName: \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.104763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.104692 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.104763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.104725 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6nd\" (UniqueName: \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.104763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.104756 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.107258 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.107230 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.107258 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.107246 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.128893 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.128872 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6nd\" (UniqueName: \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\") pod \"maas-controller-67c6566688-4nk2h\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.180993 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.180962 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:15.185718 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:17:15.185693 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc55e7f2_6d0c_48d9_bfa5_04013a4655b4.slice/crio-2c9fe1eed36c53af43b27b830258be6d93a04204936d869542315d88b7a8a904 WatchSource:0}: Error finding container 2c9fe1eed36c53af43b27b830258be6d93a04204936d869542315d88b7a8a904: Status 404 returned error can't find the container with id 2c9fe1eed36c53af43b27b830258be6d93a04204936d869542315d88b7a8a904 Oct 30 14:17:15.225815 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.225789 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:15.361193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.361109 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-w4wzs" event={"ID":"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4","Type":"ContainerStarted","Data":"2c9fe1eed36c53af43b27b830258be6d93a04204936d869542315d88b7a8a904"} Oct 30 14:17:15.526509 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:15.526477 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:17:15.530797 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:17:15.530772 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d465bf_6934_42d5_a467_37b505fa3284.slice/crio-c57bac2f28f405d35cb70b87b43f1db5b8109de0e94a2266b699c6171a864de9 WatchSource:0}: Error finding container c57bac2f28f405d35cb70b87b43f1db5b8109de0e94a2266b699c6171a864de9: Status 404 returned error can't find the container with id c57bac2f28f405d35cb70b87b43f1db5b8109de0e94a2266b699c6171a864de9 Oct 30 14:17:16.371806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:16.371723 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c6566688-4nk2h" event={"ID":"97d465bf-6934-42d5-a467-37b505fa3284","Type":"ContainerStarted","Data":"c57bac2f28f405d35cb70b87b43f1db5b8109de0e94a2266b699c6171a864de9"} Oct 30 14:17:18.388909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.388810 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c6566688-4nk2h" event={"ID":"97d465bf-6934-42d5-a467-37b505fa3284","Type":"ContainerStarted","Data":"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d"} Oct 30 14:17:18.388909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.388889 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:18.390447 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.390422 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-w4wzs" event={"ID":"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4","Type":"ContainerStarted","Data":"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7"} Oct 30 14:17:18.390622 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.390606 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:18.441759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.441712 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-67c6566688-4nk2h" podStartSLOduration=1.681620352 podStartE2EDuration="4.441700487s" totalImagesPullingTime="2.760080135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:17:18.441003489 +0000 UTC m=+589.779802498" watchObservedRunningTime="2026-10-30 14:17:18.441700487 +0000 UTC m=+589.780499540" Oct 30 14:17:18.448821 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.448782 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:18.606496 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:18.606465 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:23.102958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:23.102923 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:23.289191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:23.289151 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:29.397686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.397655 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:17:29.398122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.397732 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:29.443705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.441805 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-577f596567-w4wzs" podStartSLOduration=12.499983316 podStartE2EDuration="15.44178791s" totalImagesPullingTime="2.941804594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:17:18.491246481 +0000 UTC m=+589.830045490" watchObservedRunningTime="2026-10-30 14:17:29.44178791 +0000 UTC m=+600.780586921" Oct 30 14:17:29.515419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.515390 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:29.515649 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.515622 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-577f596567-w4wzs" podUID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" containerName="manager" containerID="cri-o://6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7" gracePeriod=30 Oct 30 14:17:29.759633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.759608 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:29.942877 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.942799 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\" (UniqueName: \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\") pod \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " Oct 30 14:17:29.943022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.942885 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\") pod \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " Oct 30 14:17:29.943022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.942927 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\") pod \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\" (UID: \"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4\") " Oct 30 14:17:29.945291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.945257 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert" pod "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" (UID: "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:17:29.945291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.945267 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7" pod "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" (UID: "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4"). InnerVolumeSpecName "kube-api-access-qbtl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:17:29.945291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:29.945276 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs" pod "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" (UID: "fc55e7f2-6d0c-48d9-bfa5-04013a4655b4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:17:30.043806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.043776 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:30.043806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.043801 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbtl7\" (UniqueName: \"kubernetes.io/projected/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-kube-api-access-qbtl7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:30.043806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.043811 5768 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4-webhook-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:17:30.450069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.450035 5768 generic.go:356] "Generic (PLEG): container finished" podID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" containerID="6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7" exitCode=0 Oct 30 14:17:30.450482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.450078 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-577f596567-w4wzs" Oct 30 14:17:30.450482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.450081 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-w4wzs" event={"ID":"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4","Type":"ContainerDied","Data":"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7"} Oct 30 14:17:30.450482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.450125 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-577f596567-w4wzs" event={"ID":"fc55e7f2-6d0c-48d9-bfa5-04013a4655b4","Type":"ContainerDied","Data":"2c9fe1eed36c53af43b27b830258be6d93a04204936d869542315d88b7a8a904"} Oct 30 14:17:30.450482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.450148 5768 scope.go:122] "RemoveContainer" containerID="6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7" Oct 30 14:17:30.460006 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.459988 5768 scope.go:122] "RemoveContainer" containerID="6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7" Oct 30 14:17:30.460288 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:30.460272 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7\": container with ID starting with 6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7 not found: ID does not exist" containerID="6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7" Oct 30 14:17:30.460341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.460299 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7"} err="failed to get container status \"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7\": rpc error: code = NotFound desc = could not find container \"6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7\": container with ID starting with 6eff0df5995bd95af3b7f183da1144a7051e9c63c9dea4996a0c701b114960f7 not found: ID does not exist" Oct 30 14:17:30.503483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.503456 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:30.515231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.515206 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-577f596567-w4wzs"] Oct 30 14:17:30.786855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:30.786775 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" path="/var/lib/kubelet/pods/fc55e7f2-6d0c-48d9-bfa5-04013a4655b4/volumes" Oct 30 14:17:31.844302 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:17:31.844266 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:17:35.932476 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:35.932441 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:48.615648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:48.615605 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:48.786684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:48.786646 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:50.031711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.031676 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:50.213413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.213380 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:50.363980 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.363877 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:50.527132 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.527103 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:17:50.567677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.567643 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:17:50.568144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.568122 5768 cpu_manager.go:414] "containerMap: removing container" podUID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" containerName="manager" Oct 30 14:17:50.568295 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.568277 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" containerName="manager" Oct 30 14:17:50.568418 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.568406 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc55e7f2-6d0c-48d9-bfa5-04013a4655b4" containerName="manager" Oct 30 14:17:50.571600 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.571581 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.587648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.587630 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 30 14:17:50.602045 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.602019 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.602122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.602064 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.602122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.602086 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngpbp\" (UniqueName: \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.602122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.602103 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.604336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.604323 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 30 14:17:50.618428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.618372 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:17:50.687309 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.687268 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bm7kg\"" Oct 30 14:17:50.702677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.702649 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.702805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.702682 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngpbp\" (UniqueName: \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.702805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.702703 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.702805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.702755 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.703314 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.703294 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.705301 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.705279 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.705393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.705345 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.726865 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.726836 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngpbp\" (UniqueName: \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\") pod \"maas-api-5c48877c75-tb25k\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:50.884342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:50.884271 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:51.194044 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:51.194009 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:17:51.198448 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:17:51.198408 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a3170d_198a_4a6a_a53c_3146dd98d7ce.slice/crio-c1cc62fa46ba67671c07478e81b0a0336d31331c32261af90261710cf9588dd8 WatchSource:0}: Error finding container c1cc62fa46ba67671c07478e81b0a0336d31331c32261af90261710cf9588dd8: Status 404 returned error can't find the container with id c1cc62fa46ba67671c07478e81b0a0336d31331c32261af90261710cf9588dd8 Oct 30 14:17:51.553759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:51.553675 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" event={"ID":"a6a3170d-198a-4a6a-a53c-3146dd98d7ce","Type":"ContainerStarted","Data":"c1cc62fa46ba67671c07478e81b0a0336d31331c32261af90261710cf9588dd8"} Oct 30 14:17:53.572949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:53.572912 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" event={"ID":"a6a3170d-198a-4a6a-a53c-3146dd98d7ce","Type":"ContainerStarted","Data":"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713"} Oct 30 14:17:53.573387 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:53.573045 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:17:53.630043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:53.629998 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" podStartSLOduration=2.180774978 podStartE2EDuration="3.62998632s" totalImagesPullingTime="1.449211342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:17:53.629383199 +0000 UTC m=+624.968182209" watchObservedRunningTime="2026-10-30 14:17:53.62998632 +0000 UTC m=+624.968785364" Oct 30 14:17:59.583028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:17:59.583002 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:18:01.844353 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:18:01.844315 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:18:31.844910 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:18:31.844863 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:18:34.289039 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:34.288971 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:34.532622 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:34.532586 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:36.057489 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:36.057452 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:51.864082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.864048 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47"] Oct 30 14:18:51.868163 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.868137 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.883441 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.883418 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 14:18:51.895335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.895313 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 14:18:51.895835 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.895809 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-btpq5\"" Oct 30 14:18:51.895914 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.895898 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Oct 30 14:18:51.898082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.898058 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47"] Oct 30 14:18:51.925903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.925874 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.926022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.925911 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.926105 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.926084 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bb14377-9f18-48e5-b7c5-52fd291c2112-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.926191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.926141 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.926191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.926183 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnwwn\" (UniqueName: \"kubernetes.io/projected/1bb14377-9f18-48e5-b7c5-52fd291c2112-kube-api-access-wnwwn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.926299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.926249 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:51.978623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:51.978590 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:52.027615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027591 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bb14377-9f18-48e5-b7c5-52fd291c2112-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027756 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027627 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027756 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027644 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnwwn\" (UniqueName: \"kubernetes.io/projected/1bb14377-9f18-48e5-b7c5-52fd291c2112-kube-api-access-wnwwn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027755 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027830 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027857 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.027978 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.027964 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.028091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.028074 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.028155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.028146 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.030148 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.030119 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bb14377-9f18-48e5-b7c5-52fd291c2112-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.030361 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.030345 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bb14377-9f18-48e5-b7c5-52fd291c2112-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.052078 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.052052 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnwwn\" (UniqueName: \"kubernetes.io/projected/1bb14377-9f18-48e5-b7c5-52fd291c2112-kube-api-access-wnwwn\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-9rw47\" (UID: \"1bb14377-9f18-48e5-b7c5-52fd291c2112\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.181520 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.181488 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:52.489265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.489137 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47"] Oct 30 14:18:52.493791 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:18:52.493765 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb14377_9f18_48e5_b7c5_52fd291c2112.slice/crio-61eba163fa59021bc4e1022026239c7950a4a0c39cf0d71b56d240ef89b8007e WatchSource:0}: Error finding container 61eba163fa59021bc4e1022026239c7950a4a0c39cf0d71b56d240ef89b8007e: Status 404 returned error can't find the container with id 61eba163fa59021bc4e1022026239c7950a4a0c39cf0d71b56d240ef89b8007e Oct 30 14:18:52.850605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:52.850517 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" event={"ID":"1bb14377-9f18-48e5-b7c5-52fd291c2112","Type":"ContainerStarted","Data":"61eba163fa59021bc4e1022026239c7950a4a0c39cf0d71b56d240ef89b8007e"} Oct 30 14:18:53.857137 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:53.857103 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" event={"ID":"1bb14377-9f18-48e5-b7c5-52fd291c2112","Type":"ContainerStarted","Data":"f8fd80c32bf83035e8288b50496c4b7dbdd01df011f6d2b018c279cc9c6fd29b"} Oct 30 14:18:53.901128 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:53.901030 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" podStartSLOduration=1.758410953 podStartE2EDuration="2.901016804s" totalImagesPullingTime="1.142605851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:18:53.900066797 +0000 UTC m=+685.238865808" watchObservedRunningTime="2026-10-30 14:18:53.901016804 +0000 UTC m=+685.239815814" Oct 30 14:18:54.182145 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:54.182115 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:18:55.733957 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.733921 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8"] Oct 30 14:18:55.737664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.737644 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764212 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764182 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764371 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764228 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764371 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764254 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Oct 30 14:18:55.764371 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764257 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkjnv\" (UniqueName: \"kubernetes.io/projected/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-kube-api-access-gkjnv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764371 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764350 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764404 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.764618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.764507 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.767159 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.767137 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8"] Oct 30 14:18:55.847518 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.847473 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:55.865525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865497 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkjnv\" (UniqueName: \"kubernetes.io/projected/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-kube-api-access-gkjnv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865571 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865617 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865665 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865717 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865756 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.865985 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.865951 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.866111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.866091 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.866201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.866142 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.867944 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.867926 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.868227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.868210 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:55.891679 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:55.891656 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkjnv\" (UniqueName: \"kubernetes.io/projected/0a33cb23-f9aa-4ac6-81f6-743d759f3bd3-kube-api-access-gkjnv\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2qwc8\" (UID: \"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:56.050787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:56.050717 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:56.352061 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:56.351978 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8"] Oct 30 14:18:56.356114 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:18:56.356088 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a33cb23_f9aa_4ac6_81f6_743d759f3bd3.slice/crio-caa73478c0a09db0db24fbb14466b7d419aa81088e82e596a503ee72857b6d22 WatchSource:0}: Error finding container caa73478c0a09db0db24fbb14466b7d419aa81088e82e596a503ee72857b6d22: Status 404 returned error can't find the container with id caa73478c0a09db0db24fbb14466b7d419aa81088e82e596a503ee72857b6d22 Oct 30 14:18:56.873640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:56.873558 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" event={"ID":"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3","Type":"ContainerStarted","Data":"e2b3b0f43b12cc66cda9a152ae2ba008c069f8f7aac6afea4b12a51295611b19"} Oct 30 14:18:56.873640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:56.873609 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" event={"ID":"0a33cb23-f9aa-4ac6-81f6-743d759f3bd3","Type":"ContainerStarted","Data":"caa73478c0a09db0db24fbb14466b7d419aa81088e82e596a503ee72857b6d22"} Oct 30 14:18:56.916850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:56.916807 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" podStartSLOduration=1.71354672 podStartE2EDuration="1.916793422s" totalImagesPullingTime="203.246702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:18:56.916322471 +0000 UTC m=+688.255121483" watchObservedRunningTime="2026-10-30 14:18:56.916793422 +0000 UTC m=+688.255592431" Oct 30 14:18:57.050982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:57.050948 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:18:57.349211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:57.349122 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:18:59.641010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:18:59.640965 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:00.877914 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:00.877870 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:01.071465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.071430 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7"] Oct 30 14:19:01.075716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.075683 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.092046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.092023 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Oct 30 14:19:01.106260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.106233 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7"] Oct 30 14:19:01.125370 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125330 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.125575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125391 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.125575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125527 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.125717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125584 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.125717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125687 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.125824 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.125723 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzpw\" (UniqueName: \"kubernetes.io/projected/004699c9-5fa9-4e2c-aa35-3d47bec3402a-kube-api-access-dnzpw\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.161347 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.161252 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:01.226330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226290 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226340 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226381 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226511 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226593 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226783 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226624 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzpw\" (UniqueName: \"kubernetes.io/projected/004699c9-5fa9-4e2c-aa35-3d47bec3402a-kube-api-access-dnzpw\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226841 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226785 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226852 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.226939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.226895 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.228977 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.228946 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004699c9-5fa9-4e2c-aa35-3d47bec3402a-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.229086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.229036 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004699c9-5fa9-4e2c-aa35-3d47bec3402a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.250477 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.250451 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzpw\" (UniqueName: \"kubernetes.io/projected/004699c9-5fa9-4e2c-aa35-3d47bec3402a-kube-api-access-dnzpw\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7\" (UID: \"004699c9-5fa9-4e2c-aa35-3d47bec3402a\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.393886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.393846 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:01.764320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.764227 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7"] Oct 30 14:19:01.768270 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:01.768243 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004699c9_5fa9_4e2c_aa35_3d47bec3402a.slice/crio-ba1c7e5c6015ff011c61c1229fd8b7393853466502704a27cdfbb88097526bd7 WatchSource:0}: Error finding container ba1c7e5c6015ff011c61c1229fd8b7393853466502704a27cdfbb88097526bd7: Status 404 returned error can't find the container with id ba1c7e5c6015ff011c61c1229fd8b7393853466502704a27cdfbb88097526bd7 Oct 30 14:19:01.844806 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:19:01.844761 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:19:01.897702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:01.897672 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" event={"ID":"004699c9-5fa9-4e2c-aa35-3d47bec3402a","Type":"ContainerStarted","Data":"ba1c7e5c6015ff011c61c1229fd8b7393853466502704a27cdfbb88097526bd7"} Oct 30 14:19:02.182633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:02.182599 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:19:02.195100 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:02.195070 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:19:02.903880 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:02.903837 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" event={"ID":"004699c9-5fa9-4e2c-aa35-3d47bec3402a","Type":"ContainerStarted","Data":"f1c0ca5707746780f7f8b72e9029075eaf80f6963ec14557b6da89ba13f4c7cf"} Oct 30 14:19:02.915263 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:02.915246 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-9rw47" Oct 30 14:19:02.951083 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:02.951031 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" podStartSLOduration=1.753925369 podStartE2EDuration="1.951018964s" totalImagesPullingTime="197.093595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:02.949893234 +0000 UTC m=+694.288692241" watchObservedRunningTime="2026-10-30 14:19:02.951018964 +0000 UTC m=+694.289817993" Oct 30 14:19:03.000446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.000415 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq"] Oct 30 14:19:03.004480 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.004458 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.021974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.021943 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Oct 30 14:19:03.028753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.028730 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq"] Oct 30 14:19:03.045787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045763 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jdc\" (UniqueName: \"kubernetes.io/projected/d7f770d8-4f3b-4c56-b862-09475a86e8bc-kube-api-access-j7jdc\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.045927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045821 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.045927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045841 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.045927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045880 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.045927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045907 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.046075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.045990 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.099477 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.099434 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:03.147009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.146954 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147026 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jdc\" (UniqueName: \"kubernetes.io/projected/d7f770d8-4f3b-4c56-b862-09475a86e8bc-kube-api-access-j7jdc\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147083 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147105 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147122 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147140 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147519 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147593 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.147653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.147621 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.149440 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.149418 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7f770d8-4f3b-4c56-b862-09475a86e8bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.149711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.149694 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7f770d8-4f3b-4c56-b862-09475a86e8bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.170801 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.170766 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jdc\" (UniqueName: \"kubernetes.io/projected/d7f770d8-4f3b-4c56-b862-09475a86e8bc-kube-api-access-j7jdc\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq\" (UID: \"d7f770d8-4f3b-4c56-b862-09475a86e8bc\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.319624 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.319584 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:03.394983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.394948 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:03.621815 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.621742 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq"] Oct 30 14:19:03.626851 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:03.626823 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7f770d8_4f3b_4c56_b862_09475a86e8bc.slice/crio-4addd3af021f962dfb41b70324ed94a92bfe8efde3ec08f2988251aa8752b276 WatchSource:0}: Error finding container 4addd3af021f962dfb41b70324ed94a92bfe8efde3ec08f2988251aa8752b276: Status 404 returned error can't find the container with id 4addd3af021f962dfb41b70324ed94a92bfe8efde3ec08f2988251aa8752b276 Oct 30 14:19:03.915586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.913851 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" event={"ID":"d7f770d8-4f3b-4c56-b862-09475a86e8bc","Type":"ContainerStarted","Data":"6a33a65378604c17fdb9852d80cffe5cb62147a5fe9d5a070ce63016467eac6a"} Oct 30 14:19:03.915586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.913900 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" event={"ID":"d7f770d8-4f3b-4c56-b862-09475a86e8bc","Type":"ContainerStarted","Data":"4addd3af021f962dfb41b70324ed94a92bfe8efde3ec08f2988251aa8752b276"} Oct 30 14:19:03.959656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:03.959529 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" podStartSLOduration=1.762136131 podStartE2EDuration="1.959516072s" totalImagesPullingTime="197.379941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:03.959017045 +0000 UTC m=+695.297816056" watchObservedRunningTime="2026-10-30 14:19:03.959516072 +0000 UTC m=+695.298315081" Oct 30 14:19:04.319883 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:04.319853 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:05.923116 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:05.923071 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:06.051442 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:06.051408 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:19:06.064245 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:06.064219 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:19:06.941758 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:06.941724 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2qwc8" Oct 30 14:19:08.172584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.172538 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx"] Oct 30 14:19:08.176213 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.176195 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.191613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.191570 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 14:19:08.191746 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.191614 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sx525\"" Oct 30 14:19:08.205862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.205833 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx"] Oct 30 14:19:08.307621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307586 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307619 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307646 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2f65b1-0983-4cdb-9405-894e69601e34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307776 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307795 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307812 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307827 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.307854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.307841 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qg6z\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-kube-api-access-5qg6z\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.308148 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.308074 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409368 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409402 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409423 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409437 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409453 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qg6z\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-kube-api-access-5qg6z\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409506 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409574 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409599 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.409777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409637 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2f65b1-0983-4cdb-9405-894e69601e34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.410106 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409871 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.410106 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.409910 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.410106 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.410035 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.410271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.410242 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c2f65b1-0983-4cdb-9405-894e69601e34-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.410457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.410434 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.411876 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.411854 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.412252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.412232 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.436597 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.436502 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.436910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.436883 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qg6z\" (UniqueName: \"kubernetes.io/projected/6c2f65b1-0983-4cdb-9405-894e69601e34-kube-api-access-5qg6z\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-sz9hx\" (UID: \"6c2f65b1-0983-4cdb-9405-894e69601e34\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.490154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.490114 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:08.834753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.834665 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx"] Oct 30 14:19:08.844802 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:08.844775 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2f65b1_0983_4cdb_9405_894e69601e34.slice/crio-7aeb72a2a8385d47465324cf3a164a0d76d4622da45689d87ab10fe3e2a8f286 WatchSource:0}: Error finding container 7aeb72a2a8385d47465324cf3a164a0d76d4622da45689d87ab10fe3e2a8f286: Status 404 returned error can't find the container with id 7aeb72a2a8385d47465324cf3a164a0d76d4622da45689d87ab10fe3e2a8f286 Oct 30 14:19:08.942999 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:08.942967 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" event={"ID":"6c2f65b1-0983-4cdb-9405-894e69601e34","Type":"ContainerStarted","Data":"7aeb72a2a8385d47465324cf3a164a0d76d4622da45689d87ab10fe3e2a8f286"} Oct 30 14:19:11.394513 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.394475 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:11.408392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.408366 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:11.786383 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.786352 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:11.786494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.786410 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:11.786494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.786442 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:11.963777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.963746 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" event={"ID":"6c2f65b1-0983-4cdb-9405-894e69601e34","Type":"ContainerStarted","Data":"d5baec4e0a7ab038120b7131c9db54800041ce0e864b3dee098386fdcbcd9237"} Oct 30 14:19:11.975574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:11.975522 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7" Oct 30 14:19:12.011659 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:12.011605 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podStartSLOduration=1.072931292 podStartE2EDuration="4.011592368s" totalImagesPullingTime="2.938661076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:12.00966515 +0000 UTC m=+703.348464156" watchObservedRunningTime="2026-10-30 14:19:12.011592368 +0000 UTC m=+703.350391378" Oct 30 14:19:12.491189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:12.491145 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:12.492624 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:12.492595 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:12.492743 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:12.492648 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:13.320340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:13.320307 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:13.333007 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:13.332981 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:13.490769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:13.490725 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:13.490938 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:13.490785 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:14.005234 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:14.005209 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" Oct 30 14:19:14.490946 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:14.490898 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:14.491124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:14.490973 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:15.490955 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:15.490918 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:15.491364 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:15.490973 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:16.490540 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:16.490502 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:16.490751 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:16.490591 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:17.490945 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:17.490909 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:17.491347 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:17.490962 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:18.490961 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.490921 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Oct 30 14:19:18.491338 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.491007 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" podUID="6c2f65b1-0983-4cdb-9405-894e69601e34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Oct 30 14:19:18.922878 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.922842 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68f74d955b-rmg54"] Oct 30 14:19:18.927184 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.927165 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:18.935996 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.935972 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-tls-cert\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:18.936096 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.936009 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sdbc\" (UniqueName: \"kubernetes.io/projected/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-kube-api-access-9sdbc\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:18.946542 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:18.946508 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f74d955b-rmg54"] Oct 30 14:19:19.037389 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.037359 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-tls-cert\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:19.037389 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.037389 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sdbc\" (UniqueName: \"kubernetes.io/projected/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-kube-api-access-9sdbc\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:19.040270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.040238 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-tls-cert\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:19.061344 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.061318 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sdbc\" (UniqueName: \"kubernetes.io/projected/7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4-kube-api-access-9sdbc\") pod \"authorino-68f74d955b-rmg54\" (UID: \"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4\") " pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:19.241392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.241295 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68f74d955b-rmg54" Oct 30 14:19:19.496182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.496096 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:19.566809 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.566778 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68f74d955b-rmg54"] Oct 30 14:19:19.573169 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:19.573140 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7373bb1e_e404_44bc_b51a_c5ec4ae0f2c4.slice/crio-b843d702b822021b5c6913b0931adebea4e37337d90ae977881a25f247b143b9 WatchSource:0}: Error finding container b843d702b822021b5c6913b0931adebea4e37337d90ae977881a25f247b143b9: Status 404 returned error can't find the container with id b843d702b822021b5c6913b0931adebea4e37337d90ae977881a25f247b143b9 Oct 30 14:19:19.647754 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:19.647719 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:20.029811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:20.029761 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f74d955b-rmg54" event={"ID":"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4","Type":"ContainerStarted","Data":"b843d702b822021b5c6913b0931adebea4e37337d90ae977881a25f247b143b9"} Oct 30 14:19:20.209806 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:20.209771 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:20.210606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:20.210578 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:20.211166 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:20.211145 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-sz9hx" Oct 30 14:19:21.037211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.037168 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68f74d955b-rmg54" event={"ID":"7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4","Type":"ContainerStarted","Data":"ab9767d3f453f67d61639ad0af8276c0f2f0175e1fc3c77df1f293c76af832cd"} Oct 30 14:19:21.081054 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.080994 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-68f74d955b-rmg54" podStartSLOduration=2.290184674 podStartE2EDuration="3.080975104s" totalImagesPullingTime="790.79043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:21.079383081 +0000 UTC m=+712.418182092" watchObservedRunningTime="2026-10-30 14:19:21.080975104 +0000 UTC m=+712.419774115" Oct 30 14:19:21.111725 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.111681 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:19:21.111950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.111923 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" podUID="d2487a6e-d968-40d1-8cc9-b4174383decf" containerName="authorino" containerID="cri-o://6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047" gracePeriod=30 Oct 30 14:19:21.387765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.387735 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:19:21.463674 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.463644 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\" (UniqueName: \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\") pod \"d2487a6e-d968-40d1-8cc9-b4174383decf\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " Oct 30 14:19:21.463842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.463733 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\" (UniqueName: \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\") pod \"d2487a6e-d968-40d1-8cc9-b4174383decf\" (UID: \"d2487a6e-d968-40d1-8cc9-b4174383decf\") " Oct 30 14:19:21.465910 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.465885 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9" pod "d2487a6e-d968-40d1-8cc9-b4174383decf" (UID: "d2487a6e-d968-40d1-8cc9-b4174383decf"). InnerVolumeSpecName "kube-api-access-gx6b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:19:21.476412 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.476389 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert" pod "d2487a6e-d968-40d1-8cc9-b4174383decf" (UID: "d2487a6e-d968-40d1-8cc9-b4174383decf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:19:21.565091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.565005 5768 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d2487a6e-d968-40d1-8cc9-b4174383decf-tls-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:19:21.565091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:21.565048 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx6b9\" (UniqueName: \"kubernetes.io/projected/d2487a6e-d968-40d1-8cc9-b4174383decf-kube-api-access-gx6b9\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:19:22.043717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.043679 5768 generic.go:356] "Generic (PLEG): container finished" podID="d2487a6e-d968-40d1-8cc9-b4174383decf" containerID="6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047" exitCode=0 Oct 30 14:19:22.044146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.043753 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" Oct 30 14:19:22.044146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.043758 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" event={"ID":"d2487a6e-d968-40d1-8cc9-b4174383decf","Type":"ContainerDied","Data":"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047"} Oct 30 14:19:22.044146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.043801 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-568bd4bb5f-4gtft" event={"ID":"d2487a6e-d968-40d1-8cc9-b4174383decf","Type":"ContainerDied","Data":"abdfcbc5628c04783eb818640d12baf84ebbec8af1abc7c694a29149252f8c61"} Oct 30 14:19:22.044146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.043813 5768 scope.go:122] "RemoveContainer" containerID="6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047" Oct 30 14:19:22.053086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.053067 5768 scope.go:122] "RemoveContainer" containerID="6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047" Oct 30 14:19:22.053374 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:19:22.053350 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047\": container with ID starting with 6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047 not found: ID does not exist" containerID="6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047" Oct 30 14:19:22.053463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.053382 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047"} err="failed to get container status \"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047\": rpc error: code = NotFound desc = could not find container \"6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047\": container with ID starting with 6f1b5a36c0a2a9041797181de908a07614a755c2940d7514b605e1e45c1b6047 not found: ID does not exist" Oct 30 14:19:22.106308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.106273 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:19:22.115013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.114984 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-568bd4bb5f-4gtft"] Oct 30 14:19:22.782959 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:22.782921 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2487a6e-d968-40d1-8cc9-b4174383decf" path="/var/lib/kubelet/pods/d2487a6e-d968-40d1-8cc9-b4174383decf/volumes" Oct 30 14:19:24.939244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:24.939217 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:25.063614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.063582 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7"] Oct 30 14:19:25.064088 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.064073 5768 cpu_manager.go:414] "containerMap: removing container" podUID="d2487a6e-d968-40d1-8cc9-b4174383decf" containerName="authorino" Oct 30 14:19:25.064088 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.064088 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2487a6e-d968-40d1-8cc9-b4174383decf" containerName="authorino" Oct 30 14:19:25.064208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.064167 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2487a6e-d968-40d1-8cc9-b4174383decf" containerName="authorino" Oct 30 14:19:25.069074 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.069054 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.089182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.089151 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7"] Oct 30 14:19:25.098044 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.098013 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:25.098768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.098753 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t66vc\"" Oct 30 14:19:25.098860 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.098789 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 30 14:19:25.117943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.117919 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z7ss\" (UniqueName: \"kubernetes.io/projected/61464ddd-b20c-41cf-b1f7-9c8aace04636-kube-api-access-9z7ss\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.118086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.117953 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61464ddd-b20c-41cf-b1f7-9c8aace04636-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.218650 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.218566 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z7ss\" (UniqueName: \"kubernetes.io/projected/61464ddd-b20c-41cf-b1f7-9c8aace04636-kube-api-access-9z7ss\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.218650 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.218605 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61464ddd-b20c-41cf-b1f7-9c8aace04636-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.219329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.219310 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/61464ddd-b20c-41cf-b1f7-9c8aace04636-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.242676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.242648 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z7ss\" (UniqueName: \"kubernetes.io/projected/61464ddd-b20c-41cf-b1f7-9c8aace04636-kube-api-access-9z7ss\") pod \"payload-pre-processing-7b98bb678c-n7zn7\" (UID: \"61464ddd-b20c-41cf-b1f7-9c8aace04636\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.383126 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.383093 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:25.686473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:25.686444 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7"] Oct 30 14:19:25.691254 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:25.691225 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61464ddd_b20c_41cf_b1f7_9c8aace04636.slice/crio-ae127ae28827c409977cc96ad1374e7cb174c42400dbd79707b76bcf1578e1a0 WatchSource:0}: Error finding container ae127ae28827c409977cc96ad1374e7cb174c42400dbd79707b76bcf1578e1a0: Status 404 returned error can't find the container with id ae127ae28827c409977cc96ad1374e7cb174c42400dbd79707b76bcf1578e1a0 Oct 30 14:19:26.071235 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:26.071150 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" event={"ID":"61464ddd-b20c-41cf-b1f7-9c8aace04636","Type":"ContainerStarted","Data":"ae127ae28827c409977cc96ad1374e7cb174c42400dbd79707b76bcf1578e1a0"} Oct 30 14:19:28.084230 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:28.084140 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" event={"ID":"61464ddd-b20c-41cf-b1f7-9c8aace04636","Type":"ContainerStarted","Data":"2609d914f6b1b8568ecdf0015df46469e42dfce36f712eb2ce582856626dbd42"} Oct 30 14:19:28.084605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:28.084280 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:28.127946 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:28.127886 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" podStartSLOduration=0.987454333 podStartE2EDuration="3.127868713s" totalImagesPullingTime="2.14041438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:28.125846997 +0000 UTC m=+719.464646006" watchObservedRunningTime="2026-10-30 14:19:28.127868713 +0000 UTC m=+719.466667724" Oct 30 14:19:31.844974 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:19:31.844933 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:19:34.045684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.045651 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-685fc76c5-7qqzk"] Oct 30 14:19:34.050481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.050462 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.070651 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.070628 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-685fc76c5-7qqzk"] Oct 30 14:19:34.079653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.079628 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Oct 30 14:19:34.079777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.079716 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-qszds\"" Oct 30 14:19:34.079777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.079717 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Oct 30 14:19:34.206826 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.206797 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-metrics-certs\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.207015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.206933 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kn9c\" (UniqueName: \"kubernetes.io/projected/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-kube-api-access-4kn9c\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.307445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.307372 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kn9c\" (UniqueName: \"kubernetes.io/projected/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-kube-api-access-4kn9c\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.307445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.307426 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-metrics-certs\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.309778 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.309757 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-metrics-certs\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.349211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.349184 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kn9c\" (UniqueName: \"kubernetes.io/projected/4e3fb7b2-eed6-4912-9424-3e71e12fdd69-kube-api-access-4kn9c\") pod \"ai-gateway-controller-685fc76c5-7qqzk\" (UID: \"4e3fb7b2-eed6-4912-9424-3e71e12fdd69\") " pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.363079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.363057 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:34.661112 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:34.661039 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-685fc76c5-7qqzk"] Oct 30 14:19:34.665639 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:34.665609 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3fb7b2_eed6_4912_9424_3e71e12fdd69.slice/crio-c2d0992cddb560230b540006ac8e3c1aef2827b482b99c01b9c771c7947c5e5b WatchSource:0}: Error finding container c2d0992cddb560230b540006ac8e3c1aef2827b482b99c01b9c771c7947c5e5b: Status 404 returned error can't find the container with id c2d0992cddb560230b540006ac8e3c1aef2827b482b99c01b9c771c7947c5e5b Oct 30 14:19:35.121857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:35.121817 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" event={"ID":"4e3fb7b2-eed6-4912-9424-3e71e12fdd69","Type":"ContainerStarted","Data":"c2d0992cddb560230b540006ac8e3c1aef2827b482b99c01b9c771c7947c5e5b"} Oct 30 14:19:36.180823 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:36.180787 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:36.372711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:36.372674 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:37.134293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:37.134206 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" event={"ID":"4e3fb7b2-eed6-4912-9424-3e71e12fdd69","Type":"ContainerStarted","Data":"85f0b0829ec7ca05c21b1e72ecdbbb50c582fc0ecd52a6efd7fe4a69ff43fcd1"} Oct 30 14:19:37.134293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:37.134273 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:37.181228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:37.181176 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" podStartSLOduration=1.010887426 podStartE2EDuration="3.181161969s" totalImagesPullingTime="2.170274543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:37.180307245 +0000 UTC m=+728.519106255" watchObservedRunningTime="2026-10-30 14:19:37.181161969 +0000 UTC m=+728.519961000" Oct 30 14:19:38.279519 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.279485 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm"] Oct 30 14:19:38.283191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.283171 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.302139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.302106 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6"] Oct 30 14:19:38.305708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.305688 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.319272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.319249 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm"] Oct 30 14:19:38.332032 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.332002 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6"] Oct 30 14:19:38.448432 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448355 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.448432 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448394 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.448692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448486 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.448692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448526 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.448692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448631 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.448879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448702 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.448879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448743 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.448879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448804 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.448879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448832 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448898 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448940 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448955 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448970 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.448990 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhcxh\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-kube-api-access-dhcxh\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.449005 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.449041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.449038 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59cg6\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-kube-api-access-59cg6\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.449272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.449107 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.449272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.449166 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cccb5d9-5411-495e-9681-e667802c8bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550193 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550239 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550261 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550280 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550398 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550458 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550486 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550508 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550566 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550615 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhcxh\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-kube-api-access-dhcxh\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550645 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550682 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59cg6\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-kube-api-access-59cg6\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550710 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550718 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550736 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cccb5d9-5411-495e-9681-e667802c8bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550770 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550797 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.550887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550847 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550891 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.551342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550911 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.551342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551046 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.551342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551175 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551191 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.551625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551350 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.550917 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551739 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551631 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5cccb5d9-5411-495e-9681-e667802c8bc1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551855 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.551988 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.551967 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.553246 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.553227 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.553426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.553408 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.553499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.553455 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.553811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.553792 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.574239 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.574218 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.574484 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.574468 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59cg6\" (UniqueName: \"kubernetes.io/projected/44e4e58d-16eb-4e7a-b33e-b6c3b9844777-kube-api-access-59cg6\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-n4dtm\" (UID: \"44e4e58d-16eb-4e7a-b33e-b6c3b9844777\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.574778 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.574757 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhcxh\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-kube-api-access-dhcxh\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.574850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.574833 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cccb5d9-5411-495e-9681-e667802c8bc1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-pc4s6\" (UID: \"5cccb5d9-5411-495e-9681-e667802c8bc1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.596683 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.596665 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:38.618996 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.618972 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:38.919163 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.919133 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm"] Oct 30 14:19:38.936862 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:38.936828 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e4e58d_16eb_4e7a_b33e_b6c3b9844777.slice/crio-afcc016f95688f1ec8fd3151cdb33b3f1158607e3213e0c9d52cf47fe44a4548 WatchSource:0}: Error finding container afcc016f95688f1ec8fd3151cdb33b3f1158607e3213e0c9d52cf47fe44a4548: Status 404 returned error can't find the container with id afcc016f95688f1ec8fd3151cdb33b3f1158607e3213e0c9d52cf47fe44a4548 Oct 30 14:19:38.939067 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.939034 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:38.939169 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.939106 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:38.939169 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.939139 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:38.963274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.963246 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6"] Oct 30 14:19:38.967857 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:19:38.967833 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cccb5d9_5411_495e_9681_e667802c8bc1.slice/crio-ebb322382c5bb3cc67c33860297ebe096f92dce556bf1d9d5abf188f6945b301 WatchSource:0}: Error finding container ebb322382c5bb3cc67c33860297ebe096f92dce556bf1d9d5abf188f6945b301: Status 404 returned error can't find the container with id ebb322382c5bb3cc67c33860297ebe096f92dce556bf1d9d5abf188f6945b301 Oct 30 14:19:38.970465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.970410 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:38.970579 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.970513 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:38.970660 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:38.970595 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:19:39.092229 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.092050 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-n7zn7" Oct 30 14:19:39.148082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.148049 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" event={"ID":"5cccb5d9-5411-495e-9681-e667802c8bc1","Type":"ContainerStarted","Data":"56ff9a668f4255d8038084be4d7867c7f0248296004ffe774590c294edf91e42"} Oct 30 14:19:39.148326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.148308 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" event={"ID":"5cccb5d9-5411-495e-9681-e667802c8bc1","Type":"ContainerStarted","Data":"ebb322382c5bb3cc67c33860297ebe096f92dce556bf1d9d5abf188f6945b301"} Oct 30 14:19:39.150079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.150055 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" event={"ID":"44e4e58d-16eb-4e7a-b33e-b6c3b9844777","Type":"ContainerStarted","Data":"53cf63ac4d73d2c963e936bd7400ae14132b5920641fe04ddfa62c2bdd522515"} Oct 30 14:19:39.150188 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.150115 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" event={"ID":"44e4e58d-16eb-4e7a-b33e-b6c3b9844777","Type":"ContainerStarted","Data":"afcc016f95688f1ec8fd3151cdb33b3f1158607e3213e0c9d52cf47fe44a4548"} Oct 30 14:19:39.196235 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.196125 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podStartSLOduration=1.196105618 podStartE2EDuration="1.196105618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:39.195196023 +0000 UTC m=+730.533995035" watchObservedRunningTime="2026-10-30 14:19:39.196105618 +0000 UTC m=+730.534904629" Oct 30 14:19:39.604632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.604498 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:39.605125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.604799 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:39.605125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.604858 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:39.619646 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:39.619617 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:40.607994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:40.607956 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:40.608624 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:40.608590 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:40.620828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:40.620805 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:40.620982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:40.620966 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:41.607573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:41.606658 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:41.607573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:41.606726 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:41.619689 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:41.619658 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:41.620057 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:41.619706 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:42.601572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:42.600970 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:42.601572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:42.601033 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:42.620011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:42.619976 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:42.620397 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:42.620025 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:43.602011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:43.601971 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:43.602315 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:43.602284 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:43.619691 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:43.619664 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:43.619868 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:43.619848 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:44.600575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:44.599854 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:44.600575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:44.599912 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:44.619431 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:44.619396 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:44.619602 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:44.619438 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:45.597117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:45.597077 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 30 14:19:45.597288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:45.597134 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podUID="44e4e58d-16eb-4e7a-b33e-b6c3b9844777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 30 14:19:45.619623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:45.619598 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Oct 30 14:19:45.619952 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:45.619642 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" podUID="5cccb5d9-5411-495e-9681-e667802c8bc1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Oct 30 14:19:47.335654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.335621 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:47.336097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.336023 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:47.337028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.337008 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-pc4s6" Oct 30 14:19:47.347503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.347479 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:47.347803 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.347778 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:47.348695 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.348674 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" Oct 30 14:19:47.394065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:47.394024 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-n4dtm" podStartSLOduration=9.394013305 podStartE2EDuration="9.394013305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:19:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:19:39.242287968 +0000 UTC m=+730.581086987" watchObservedRunningTime="2026-10-30 14:19:47.394013305 +0000 UTC m=+738.732812316" Oct 30 14:19:48.142334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:48.142306 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-685fc76c5-7qqzk" Oct 30 14:19:49.904879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:49.904841 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:50.417528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:50.417490 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:51.996124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:51.996090 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:52.163165 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:52.163136 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:53.471657 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:53.471613 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:19:53.624716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:19:53.624680 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:01.845240 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:01.845204 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:20:14.855659 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:14.855621 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.018421 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.018389 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.334038 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.334005 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.407393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.407352 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:20:15.411393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.411367 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.427051 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.427028 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-bf8266-openshift-default-dockercfg-9c8kq\"" Oct 30 14:20:15.441489 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.441464 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:20:15.505779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.505736 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.532226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.532193 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:20:15.536631 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.536602 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.554839 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.554814 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-7bf15f-openshift-default-dockercfg-d4kcn\"" Oct 30 14:20:15.557256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557237 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jgr\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557271 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557294 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557360 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557435 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557397 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557484 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557471 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557518 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557499 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557661 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557644 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.557704 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.557676 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.561301 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.561271 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:20:15.656208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.656126 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.658280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658259 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658369 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658290 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.658369 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658314 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658369 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658331 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658571 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658660 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658610 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.658660 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658642 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658663 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658666 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.658887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658768 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658872 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.658987 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658869 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.658987 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658937 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.658987 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.658966 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.659084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659029 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.659084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659065 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.659183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659095 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.659183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659116 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.659183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659151 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgbg8\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.659348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659206 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jgr\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.659348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659237 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.659348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659337 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.659834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.659816 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.660986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.660964 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.661238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.661222 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.689482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.689454 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.689726 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.689708 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jgr\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.725318 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.725290 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:15.760662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760633 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.760814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760671 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgbg8\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.760814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760708 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.760814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760747 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.760814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760801 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760843 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760884 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760917 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.760939 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.761067 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.761101 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.761401 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.761431 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.761486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.761462 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.763382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.763361 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.763671 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.763652 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.785898 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.785874 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.787010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.786986 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgbg8\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.826913 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.826853 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.850894 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.850859 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:15.963674 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.963640 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:20:15.977175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.977146 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:15.989124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.989093 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:15.995630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.995591 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:20:15.995761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:15.995739 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-717995-openshift-default-dockercfg-h5tlx\"" Oct 30 14:20:16.053878 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.053846 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:20:16.057880 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:16.057854 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ae2007_95a8_43c4_bb76_76b7ebec71d2.slice/crio-ea3d7682c8445d88eda4976d650ac0de34634aa714dfb20c667759cd0639e101 WatchSource:0}: Error finding container ea3d7682c8445d88eda4976d650ac0de34634aa714dfb20c667759cd0639e101: Status 404 returned error can't find the container with id ea3d7682c8445d88eda4976d650ac0de34634aa714dfb20c667759cd0639e101 Oct 30 14:20:16.060207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.060174 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.060308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.060252 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.060379 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.060310 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.159529 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.159443 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:16.165226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.165198 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:20:16.165699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.165669 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.165813 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.165734 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9dhp\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.165882 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.165836 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.165936 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.165894 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.166089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.166048 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.166198 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.166174 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.166289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.166271 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.166370 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.166353 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.166422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.166390 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.169435 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:16.169223 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6f1057_5ebb_4913_90d7_717d1fd9532b.slice/crio-e3e9f37e0d2981a5c029666598ac19d4ab4ebba62bce88b22adf81a557d044e8 WatchSource:0}: Error finding container e3e9f37e0d2981a5c029666598ac19d4ab4ebba62bce88b22adf81a557d044e8: Status 404 returned error can't find the container with id e3e9f37e0d2981a5c029666598ac19d4ab4ebba62bce88b22adf81a557d044e8 Oct 30 14:20:16.171904 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.171868 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.171994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.171952 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.172056 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.172002 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.267322 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267275 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267322 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267325 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267502 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267597 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9dhp\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267629 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267729 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267684 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267780 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267756 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267837 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267812 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.267888 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.267841 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.268129 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.268097 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.268235 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.268201 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.268423 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.268360 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.268423 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.268431 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.268423 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.268442 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.270154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.270127 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.270261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.270227 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.291816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.291781 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.292694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.292658 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9dhp\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\") pod \"e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.293801 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.293783 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:16.316514 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.316435 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:16.395537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.395498 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerStarted","Data":"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce"} Oct 30 14:20:16.395707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.395589 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerStarted","Data":"ea3d7682c8445d88eda4976d650ac0de34634aa714dfb20c667759cd0639e101"} Oct 30 14:20:16.398713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.398150 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerStarted","Data":"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31"} Oct 30 14:20:16.398713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.398194 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerStarted","Data":"e3e9f37e0d2981a5c029666598ac19d4ab4ebba62bce88b22adf81a557d044e8"} Oct 30 14:20:16.445246 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.445191 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podStartSLOduration=1.4451590300000001 podStartE2EDuration="1.44515903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:16.441482741 +0000 UTC m=+767.780281750" watchObservedRunningTime="2026-10-30 14:20:16.44515903 +0000 UTC m=+767.783958041" Oct 30 14:20:16.491293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.491211 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podStartSLOduration=1.491195432 podStartE2EDuration="1.491195432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:16.490041724 +0000 UTC m=+767.828840766" watchObservedRunningTime="2026-10-30 14:20:16.491195432 +0000 UTC m=+767.829994441" Oct 30 14:20:16.633410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.633374 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:20:16.636909 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:16.636877 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72954c43_cb8c_4d20_8ad6_fd306b746c9f.slice/crio-e4788e8aafba31ef2b8b630cefbccaf8325bfa239a719bdc17cebc9d222de109 WatchSource:0}: Error finding container e4788e8aafba31ef2b8b630cefbccaf8325bfa239a719bdc17cebc9d222de109: Status 404 returned error can't find the container with id e4788e8aafba31ef2b8b630cefbccaf8325bfa239a719bdc17cebc9d222de109 Oct 30 14:20:16.639354 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.639320 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.639422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.639388 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.639422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.639415 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:16.726073 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.726016 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:16.851185 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:16.851157 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:17.406207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:17.406171 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerStarted","Data":"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3"} Oct 30 14:20:17.406657 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:17.406239 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerStarted","Data":"e4788e8aafba31ef2b8b630cefbccaf8325bfa239a719bdc17cebc9d222de109"} Oct 30 14:20:17.453811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:17.453756 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podStartSLOduration=2.453741314 podStartE2EDuration="2.453741314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:17.451851623 +0000 UTC m=+768.790650633" watchObservedRunningTime="2026-10-30 14:20:17.453741314 +0000 UTC m=+768.792540323" Oct 30 14:20:17.731185 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:17.731158 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:17.857030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:17.856994 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:18.293999 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.293963 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:18.299162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.299135 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:18.411079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.411047 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:18.411599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.411389 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:18.411599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.411453 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:18.412184 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.412162 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:18.412289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.412230 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:18.412289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.412274 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:18.700817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.700780 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:18.858684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:18.858647 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:19.210859 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:19.210822 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:19.388712 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:19.388682 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:19.530817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:19.530730 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:20.300327 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.300289 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:20.463961 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.463915 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:20.526761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.526732 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:20:20.530731 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.530714 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.552211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.552146 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:20:20.561372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.561350 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-a5ddf3\"" Oct 30 14:20:20.561488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.561375 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-a5ddf3-dockercfg-97z5z\"" Oct 30 14:20:20.609649 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.609603 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.609852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.609694 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5glr\" (UniqueName: \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.711238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.711208 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.711394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.711262 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5glr\" (UniqueName: \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.711933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.711914 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.761179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.761147 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5glr\" (UniqueName: \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\") pod \"payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.813573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.813464 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:20.844373 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.844345 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:20.979178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:20.979144 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:21.126572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.126464 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:21.154351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.154323 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:20:21.157478 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:21.157452 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7703b483_7e39_4a3f_bded_ae434c8f0345.slice/crio-5b01ed4ba9c708afcbe41d705955e9a9d25efdf49e750648944411a9d366b716 WatchSource:0}: Error finding container 5b01ed4ba9c708afcbe41d705955e9a9d25efdf49e750648944411a9d366b716: Status 404 returned error can't find the container with id 5b01ed4ba9c708afcbe41d705955e9a9d25efdf49e750648944411a9d366b716 Oct 30 14:20:21.295246 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.295207 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:21.428659 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.428623 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" event={"ID":"7703b483-7e39-4a3f-bded-ae434c8f0345","Type":"ContainerStarted","Data":"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960"} Oct 30 14:20:21.428864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.428681 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" event={"ID":"7703b483-7e39-4a3f-bded-ae434c8f0345","Type":"ContainerStarted","Data":"5b01ed4ba9c708afcbe41d705955e9a9d25efdf49e750648944411a9d366b716"} Oct 30 14:20:21.428864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.428736 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:21.472412 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.472363 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" podStartSLOduration=1.472348705 podStartE2EDuration="1.472348705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:21.471083277 +0000 UTC m=+772.809882288" watchObservedRunningTime="2026-10-30 14:20:21.472348705 +0000 UTC m=+772.811147708" Oct 30 14:20:21.882993 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.882903 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:20:21.886986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.886964 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:21.907270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.907244 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-7bf15f-serving-cert\"" Oct 30 14:20:21.921489 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.921460 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:20:21.944358 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.944323 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:21.944527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.944372 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq2wq\" (UniqueName: \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:21.944527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.944484 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:21.944673 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:21.944526 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.016760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.016727 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:22.045783 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.045756 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq2wq\" (UniqueName: \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.045981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.045830 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.045981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.045879 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.045981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.045942 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.046731 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.046649 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.048579 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.048561 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.048676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.048657 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.069858 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.069831 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq2wq\" (UniqueName: \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\") pod \"maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.191044 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.191007 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:22.200035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.200008 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:22.344982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.344948 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:22.515260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.515183 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:20:22.518865 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:22.518843 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bb0e79_631f_49b9_80aa_d6131e05a390.slice/crio-df5387818ba9c469476d0dcc336d60ebeeb673a45ef6923c58c9743f78ffda2d WatchSource:0}: Error finding container df5387818ba9c469476d0dcc336d60ebeeb673a45ef6923c58c9743f78ffda2d: Status 404 returned error can't find the container with id df5387818ba9c469476d0dcc336d60ebeeb673a45ef6923c58c9743f78ffda2d Oct 30 14:20:22.520240 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:22.520223 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:20:23.441255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.441223 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" event={"ID":"47bb0e79-631f-49b9-80aa-d6131e05a390","Type":"ContainerStarted","Data":"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386"} Oct 30 14:20:23.441684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.441281 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" event={"ID":"47bb0e79-631f-49b9-80aa-d6131e05a390","Type":"ContainerStarted","Data":"df5387818ba9c469476d0dcc336d60ebeeb673a45ef6923c58c9743f78ffda2d"} Oct 30 14:20:23.441684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.441389 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:23.487464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.487406 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" podStartSLOduration=2.050983967 podStartE2EDuration="2.487387501s" totalImagesPullingTime="436.403534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:23.486164421 +0000 UTC m=+774.824963431" watchObservedRunningTime="2026-10-30 14:20:23.487387501 +0000 UTC m=+774.826186513" Oct 30 14:20:23.698656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.698532 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:20:23.702512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.702492 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.723065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.723046 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-bf8266-serving-cert\"" Oct 30 14:20:23.725141 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.725116 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:20:23.766467 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.766428 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzt5z\" (UniqueName: \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.766648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.766495 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.766648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.766636 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.766748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.766737 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.844079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.844042 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:23.867336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.867309 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzt5z\" (UniqueName: \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.867464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.867354 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.867464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.867378 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.867464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.867436 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.867667 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:23.867486 5768 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-serving-cert: secret "maas-api-e2e-worker-w6-bf8266-serving-cert" not found Oct 30 14:20:23.867667 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:23.867579 5768 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls podName:055c54ab-de2a-4f20-aefa-21a47b5fdbf4 nodeName:}" failed. No retries permitted until 2026-10-30 14:20:24.367560114 +0000 UTC m=+775.706359117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls") pod "maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" (UID: "055c54ab-de2a-4f20-aefa-21a47b5fdbf4") : secret "maas-api-e2e-worker-w6-bf8266-serving-cert" not found Oct 30 14:20:23.868146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.868127 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.869912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.869894 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.896079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.896052 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzt5z\" (UniqueName: \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:23.998651 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:23.998572 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:24.138360 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.138328 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:24.379669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.379579 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:24.382041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.382019 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") pod \"maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:24.616162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.616129 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:24.915916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.915882 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:24.927142 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:24.927112 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:20:24.930886 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:24.930858 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055c54ab_de2a_4f20_aefa_21a47b5fdbf4.slice/crio-f02a5a8505201c229db8b673d9e501cb313384cd452ceb4bc3230bfd710d363a WatchSource:0}: Error finding container f02a5a8505201c229db8b673d9e501cb313384cd452ceb4bc3230bfd710d363a: Status 404 returned error can't find the container with id f02a5a8505201c229db8b673d9e501cb313384cd452ceb4bc3230bfd710d363a Oct 30 14:20:25.099737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.099705 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:25.461200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.461153 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" event={"ID":"055c54ab-de2a-4f20-aefa-21a47b5fdbf4","Type":"ContainerStarted","Data":"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6"} Oct 30 14:20:25.461395 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.461249 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" event={"ID":"055c54ab-de2a-4f20-aefa-21a47b5fdbf4","Type":"ContainerStarted","Data":"f02a5a8505201c229db8b673d9e501cb313384cd452ceb4bc3230bfd710d363a"} Oct 30 14:20:25.461395 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.461281 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:25.508255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.508171 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" podStartSLOduration=2.116031853 podStartE2EDuration="2.508153402s" totalImagesPullingTime="392.121549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:25.504663184 +0000 UTC m=+776.843462205" watchObservedRunningTime="2026-10-30 14:20:25.508153402 +0000 UTC m=+776.846952418" Oct 30 14:20:25.569497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.569458 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:20:25.573258 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.573236 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.589089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.589067 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-a5ddf3-serving-cert\"" Oct 30 14:20:25.595952 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.595927 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:20:25.686336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.686303 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:25.697640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.697604 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.697803 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.697674 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ctn7\" (UniqueName: \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.697803 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.697738 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.697803 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.697792 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.798533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.798489 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.798708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.798623 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.798708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.798676 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ctn7\" (UniqueName: \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.798810 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.798748 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.800284 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.800241 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.801609 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.801542 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.801741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.801710 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.826197 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.826168 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ctn7\" (UniqueName: \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\") pod \"maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:25.852381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.852307 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:25.886689 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:25.886659 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:26.009805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:26.009772 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:26.202190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:26.202159 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:20:26.206033 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:26.206004 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf915779_2ae7_46f5_973d_f00bb27e110a.slice/crio-290853774f3a32ae90da3252cfe45759c17a8cf842c7fd3af0a72675e5f49353 WatchSource:0}: Error finding container 290853774f3a32ae90da3252cfe45759c17a8cf842c7fd3af0a72675e5f49353: Status 404 returned error can't find the container with id 290853774f3a32ae90da3252cfe45759c17a8cf842c7fd3af0a72675e5f49353 Oct 30 14:20:26.468021 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:26.467934 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" event={"ID":"af915779-2ae7-46f5-973d-f00bb27e110a","Type":"ContainerStarted","Data":"290853774f3a32ae90da3252cfe45759c17a8cf842c7fd3af0a72675e5f49353"} Oct 30 14:20:27.489102 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:27.489056 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" event={"ID":"af915779-2ae7-46f5-973d-f00bb27e110a","Type":"ContainerStarted","Data":"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8"} Oct 30 14:20:27.489603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:27.489131 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:27.532971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:27.532916 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" podStartSLOduration=2.21181204 podStartE2EDuration="2.532899074s" totalImagesPullingTime="321.087034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:27.531842457 +0000 UTC m=+778.870641467" watchObservedRunningTime="2026-10-30 14:20:27.532899074 +0000 UTC m=+778.871698085" Oct 30 14:20:27.722634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:27.722596 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:28.393088 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:28.393056 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:28.558029 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:28.557984 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:29.284826 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.284786 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:29.293919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.293887 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:20:29.298992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.298973 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.319974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.319943 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-24dfd7-serving-cert\"" Oct 30 14:20:29.331487 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.331462 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:20:29.439802 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.439771 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.439953 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.439880 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrsjc\" (UniqueName: \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.440023 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.439959 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.440117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.440092 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.452431 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.452410 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:20:29.511825 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.511771 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:29.541055 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.540969 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.541055 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.541021 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.541282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.541153 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.541282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.541197 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrsjc\" (UniqueName: \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.542667 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.542637 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.544440 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.544415 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.544560 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.544415 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.595952 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.595914 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrsjc\" (UniqueName: \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\") pod \"maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.613323 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.613294 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:29.676572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.676011 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:29.993291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:29.993267 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:20:29.995867 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:29.995842 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2526bc5_2127_444e_adc0_eaf08f1b6245.slice/crio-5332450fd1c3b5d2497a808389cb185c9f08ce8949b21ab210452960e7fd5c7d WatchSource:0}: Error finding container 5332450fd1c3b5d2497a808389cb185c9f08ce8949b21ab210452960e7fd5c7d: Status 404 returned error can't find the container with id 5332450fd1c3b5d2497a808389cb185c9f08ce8949b21ab210452960e7fd5c7d Oct 30 14:20:30.510112 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:30.510080 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" event={"ID":"a2526bc5-2127-444e-adc0-eaf08f1b6245","Type":"ContainerStarted","Data":"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114"} Oct 30 14:20:30.510288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:30.510131 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" event={"ID":"a2526bc5-2127-444e-adc0-eaf08f1b6245","Type":"ContainerStarted","Data":"5332450fd1c3b5d2497a808389cb185c9f08ce8949b21ab210452960e7fd5c7d"} Oct 30 14:20:30.510288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:30.510227 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:30.590943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:30.590887 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" podStartSLOduration=1.233381418 podStartE2EDuration="1.590873574s" totalImagesPullingTime="357.492156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:30.589571082 +0000 UTC m=+781.928370095" watchObservedRunningTime="2026-10-30 14:20:30.590873574 +0000 UTC m=+781.929672583" Oct 30 14:20:31.447445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.447409 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:20:31.451528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.451506 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.517578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.515109 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-717995-serving-cert\"" Oct 30 14:20:31.520692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.520623 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:20:31.521069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.521035 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:20:31.590275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.590229 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.590535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.590514 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.594794 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.594764 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzdjw\" (UniqueName: \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.595079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.595060 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.615462 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.615247 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.712238 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.712296 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.712387 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzdjw\" (UniqueName: \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.712451 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:31.712637 5768 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-serving-cert: secret "maas-api-e2e-worker-w1-717995-serving-cert" not found Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:31.712708 5768 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls podName:dbc81d09-fdad-477d-8d52-ee0d4ff4dab3 nodeName:}" failed. No retries permitted until 2026-10-30 14:20:32.212686488 +0000 UTC m=+783.551485499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls") pod "maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" (UID: "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3") : secret "maas-api-e2e-worker-w1-717995-serving-cert" not found Oct 30 14:20:31.717694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.713701 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.721324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.719183 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.741652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.741627 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzdjw\" (UniqueName: \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:31.804570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.801167 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:31.845224 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:20:31.845183 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:20:31.979586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:31.979431 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:32.218036 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:32.218006 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:32.220749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:32.220729 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") pod \"maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:32.419921 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:32.419889 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:32.437663 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:32.437640 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:20:32.809620 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:32.809580 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc81d09_fdad_477d_8d52_ee0d4ff4dab3.slice/crio-508fb84220a3c35e6fc20800ea4eeb709ccc9f9fe48aee0e818337005f5b87bb WatchSource:0}: Error finding container 508fb84220a3c35e6fc20800ea4eeb709ccc9f9fe48aee0e818337005f5b87bb: Status 404 returned error can't find the container with id 508fb84220a3c35e6fc20800ea4eeb709ccc9f9fe48aee0e818337005f5b87bb Oct 30 14:20:32.814799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:32.814774 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:20:33.296465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.296438 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:20:33.301716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.301694 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.319079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.319059 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-1d36cf-serving-cert\"" Oct 30 14:20:33.342578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.342462 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:20:33.425584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.425519 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:33.443257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.443232 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.443418 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.443265 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.443418 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.443309 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c824d\" (UniqueName: \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.443509 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.443473 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.501783 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.501709 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:20:33.544427 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.544397 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.544625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.544463 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.544625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.544497 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.544625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.544532 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c824d\" (UniqueName: \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.545488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.545374 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.547759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.547731 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.549301 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.549278 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.556392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.556360 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" event={"ID":"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3","Type":"ContainerStarted","Data":"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d"} Oct 30 14:20:33.556698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.556424 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:33.556698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.556451 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" event={"ID":"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3","Type":"ContainerStarted","Data":"508fb84220a3c35e6fc20800ea4eeb709ccc9f9fe48aee0e818337005f5b87bb"} Oct 30 14:20:33.590600 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.587305 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:33.593274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.593243 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c824d\" (UniqueName: \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\") pod \"maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.607965 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.607898 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" podStartSLOduration=2.200145546 podStartE2EDuration="2.607885149s" totalImagesPullingTime="407.739603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:33.606595538 +0000 UTC m=+784.945394545" watchObservedRunningTime="2026-10-30 14:20:33.607885149 +0000 UTC m=+784.946684210" Oct 30 14:20:33.615935 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.615906 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:33.950429 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:33.950336 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:20:33.953073 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:20:33.953041 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d36f6b7_28e1_4cbc_a319_93c0c5cc8b30.slice/crio-ba3aa27bf7ae941b52e4960efddc3483c53790fdc68d0cee1be89b2b30923082 WatchSource:0}: Error finding container ba3aa27bf7ae941b52e4960efddc3483c53790fdc68d0cee1be89b2b30923082: Status 404 returned error can't find the container with id ba3aa27bf7ae941b52e4960efddc3483c53790fdc68d0cee1be89b2b30923082 Oct 30 14:20:34.453715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.453677 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:20:34.453843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.453731 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:20:34.590844 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.590188 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" event={"ID":"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30","Type":"ContainerStarted","Data":"c41b1878ce04b7ce50df2e77db0a7ab8b4b3481094857105ebc7286735c41e17"} Oct 30 14:20:34.590844 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.590247 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" event={"ID":"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30","Type":"ContainerStarted","Data":"ba3aa27bf7ae941b52e4960efddc3483c53790fdc68d0cee1be89b2b30923082"} Oct 30 14:20:34.590844 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.590295 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:34.637288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:34.637237 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" podStartSLOduration=1.164388909 podStartE2EDuration="1.637218793s" totalImagesPullingTime="472.829884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:20:34.63680508 +0000 UTC m=+785.975604087" watchObservedRunningTime="2026-10-30 14:20:34.637218793 +0000 UTC m=+785.976017804" Oct 30 14:20:35.211956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:35.211910 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:35.358327 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:35.357892 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:36.305349 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:36.305314 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:36.532994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:36.532966 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:20:37.080157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.080092 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:37.623483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.623396 5768 generic.go:356] "Generic (PLEG): container finished" podID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerID="10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31" exitCode=0 Oct 30 14:20:37.623950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.623473 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerDied","Data":"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31"} Oct 30 14:20:37.623950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.623886 5768 scope.go:122] "RemoveContainer" containerID="10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31" Oct 30 14:20:37.625339 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.625313 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:37.625406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.625377 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:37.625452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:37.625412 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:38.631076 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:38.631046 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerStarted","Data":"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59"} Oct 30 14:20:38.851272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:38.851227 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:38.851461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:38.851418 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:38.851543 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:38.851459 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:38.947200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:38.947172 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:39.614064 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:39.613380 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:20:39.851281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:39.851252 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:39.851668 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:39.851300 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:40.851337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:40.851298 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:40.851739 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:40.851361 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:41.301573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:41.301009 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:41.640048 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:41.639294 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:20:41.851444 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:41.851408 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:41.851830 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:41.851477 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:42.659413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.659316 5768 generic.go:356] "Generic (PLEG): container finished" podID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerID="7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce" exitCode=0 Oct 30 14:20:42.659413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.659384 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerDied","Data":"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce"} Oct 30 14:20:42.661585 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.659842 5768 scope.go:122] "RemoveContainer" containerID="7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce" Oct 30 14:20:42.684594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.672988 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:42.684594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.673097 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:42.684594 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.673146 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:42.852593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.852229 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:42.852593 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:42.852276 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:43.411614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.411506 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:43.698945 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.698910 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerStarted","Data":"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6"} Oct 30 14:20:43.726605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.726391 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:43.726605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.726523 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:43.726865 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.726610 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:43.852216 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.852172 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Oct 30 14:20:43.852403 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:43.852240 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Oct 30 14:20:44.078741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.078179 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:44.223414 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.223376 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:44.680575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.679396 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:44.726402 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.726372 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:44.726603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.726427 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:44.847176 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.847138 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:44.856277 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.856252 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:44.856526 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.856507 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:44.857199 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:44.857179 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:20:45.008738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:45.008641 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:45.683532 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:45.683449 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:45.726258 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:45.726224 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:45.726454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:45.726281 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:46.721797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.721773 5768 generic.go:356] "Generic (PLEG): container finished" podID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerID="8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3" exitCode=0 Oct 30 14:20:46.722171 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.721839 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerDied","Data":"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3"} Oct 30 14:20:46.722361 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.722346 5768 scope.go:122] "RemoveContainer" containerID="8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3" Oct 30 14:20:46.723497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.723468 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:46.723628 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.723588 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:46.723695 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.723645 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:20:46.725626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.725603 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:46.725763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:46.725645 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:47.710574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:47.710367 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:47.726499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:47.726452 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:47.726976 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:47.726520 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:47.730297 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:47.730132 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerStarted","Data":"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79"} Oct 30 14:20:47.886587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:47.883568 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:48.296831 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.296729 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:48.298375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.298344 5768 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 30 14:20:48.298623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.298598 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 30 14:20:48.412732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.412647 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:48.412732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.412726 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:48.725825 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.725796 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 30 14:20:48.726071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.726046 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 30 14:20:48.948523 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:48.948469 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:49.295178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.295147 5768 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 30 14:20:49.295356 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.295207 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 30 14:20:49.498572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.496033 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:49.649298 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.649179 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:49.730695 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.730669 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:49.731753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.731732 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:20:49.812596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.812538 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:49.985883 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:49.985846 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:50.129832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:50.129795 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:50.294537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:50.294306 5768 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 30 14:20:50.294537 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:50.294381 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 30 14:20:50.721290 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:50.721246 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:50.887142 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:50.887055 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:51.295159 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:51.295113 5768 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 30 14:20:51.295731 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:51.295204 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 30 14:20:52.025686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:52.025645 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:52.294891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:52.294807 5768 patch_prober.go:29] interesting pod/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Oct 30 14:20:52.295041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:52.294860 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Oct 30 14:20:53.524189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:53.524154 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:53.525643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:53.525618 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:20:54.055920 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:54.055864 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:55.268011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:55.267964 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:55.418065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:55.418024 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:55.881391 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:55.881349 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:56.050716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:56.050673 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:56.201073 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:56.201041 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:57.552699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:57.552665 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:20:59.247566 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:20:59.247517 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:00.008469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:00.008434 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:00.999573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:00.999503 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:01.844863 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:21:01.844828 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:21:02.282811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:02.282771 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:02.549186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:02.549103 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:04.214270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.214236 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:04.680868 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.680831 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:21:04.685340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.685318 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.705338 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.705310 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:21:04.714308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.714281 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-137f01\"/\"simulator-w4-137f01-kserve-self-signed-certs\"" Oct 30 14:21:04.714308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.714291 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-137f01\"/\"default-dockercfg-5n5lk\"" Oct 30 14:21:04.717002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.716979 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-137f01\"/\"kube-root-ca.crt\"" Oct 30 14:21:04.717129 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.717004 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-137f01\"/\"openshift-service-ca.crt\"" Oct 30 14:21:04.774177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.774147 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:04.832965 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.832929 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.833130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.832970 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7qpk\" (UniqueName: \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.833130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.833083 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.833220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.833148 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.833265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.833217 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.833265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.833250 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.934329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934235 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.934634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934607 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.934811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934661 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.934811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934795 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.934811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934824 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7qpk\" (UniqueName: \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.935043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934873 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.935043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.934973 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.935242 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.935220 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.937076 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.935903 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.939192 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.938747 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.939443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.939423 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:04.960131 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:04.960104 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7qpk\" (UniqueName: \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\") pod \"simulator-w4-137f01-kserve-5d78744f85-zptk6\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:05.022076 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.022047 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:05.323196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.323117 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:21:05.327038 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:21:05.327011 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c839a85_98db_4604_b506_830d9cee6915.slice/crio-eb3ece8c5794b557d0d0a3b5b68c04466e525b725b21d41406e35077d9f18cbf WatchSource:0}: Error finding container eb3ece8c5794b557d0d0a3b5b68c04466e525b725b21d41406e35077d9f18cbf: Status 404 returned error can't find the container with id eb3ece8c5794b557d0d0a3b5b68c04466e525b725b21d41406e35077d9f18cbf Oct 30 14:21:05.842639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.842604 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" event={"ID":"5c839a85-98db-4604-b506-830d9cee6915","Type":"ContainerStarted","Data":"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b"} Oct 30 14:21:05.842639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.842645 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" event={"ID":"5c839a85-98db-4604-b506-830d9cee6915","Type":"ContainerStarted","Data":"eb3ece8c5794b557d0d0a3b5b68c04466e525b725b21d41406e35077d9f18cbf"} Oct 30 14:21:05.858094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.858060 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:05.892241 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:05.892180 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podStartSLOduration=1.8921618470000001 podStartE2EDuration="1.892161847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:05.890920663 +0000 UTC m=+817.229719677" watchObservedRunningTime="2026-10-30 14:21:05.892161847 +0000 UTC m=+817.230960858" Oct 30 14:21:06.022137 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:06.022108 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:07.504667 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:07.504629 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:07.838450 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:07.838359 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:09.494372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:09.494282 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:11.104761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:11.104693 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:13.051713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:13.051673 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:13.938075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:13.938036 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:14.667723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:14.667688 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:15.022980 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:15.022900 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:15.035457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:15.035427 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:15.928853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:15.928825 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:21:16.511255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:16.511221 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:18.241008 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:18.240964 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:19.861345 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:19.861278 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:21.655645 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:21.655608 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:23.379762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:23.379728 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:25.118984 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:25.118944 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:26.704849 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:26.704808 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:28.109147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:28.109102 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:28.433690 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:28.433657 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:30.369810 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:30.369772 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:31.150114 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.150074 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:21:31.155617 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.155597 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.172404 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.172383 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-24dfd7-openshift-default-dockercfg-r2zgj\"" Oct 30 14:21:31.186587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.186557 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:21:31.228195 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228163 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228214 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228320 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228348 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228340 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228409 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2cv\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228438 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228463 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228502 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.228677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.228620 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.329914 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.329877 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.329924 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330041 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330070 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330164 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2cv\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330211 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330250 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330286 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330295 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330360 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330386 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330586 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.330664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.330637 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.331087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.331062 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.332316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.332297 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.332538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.332520 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.353990 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.353963 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.354344 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.354322 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2cv\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.469064 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.469032 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:31.793686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.793591 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:21:31.796659 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:21:31.796636 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e74d135_83a5_4376_8219_4cd942ee360d.slice/crio-26972a9626424bbfdeb7f65cb9611697cb6e461a0358d40c36b9f24794015290 WatchSource:0}: Error finding container 26972a9626424bbfdeb7f65cb9611697cb6e461a0358d40c36b9f24794015290: Status 404 returned error can't find the container with id 26972a9626424bbfdeb7f65cb9611697cb6e461a0358d40c36b9f24794015290 Oct 30 14:21:31.798901 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.798863 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:21:31.799011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.798944 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:21:31.799011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:31.798987 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:21:31.845870 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:21:31.845818 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:21:32.023511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.023477 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" event={"ID":"1e74d135-83a5-4376-8219-4cd942ee360d","Type":"ContainerStarted","Data":"d69337f1bff39d2853fa1c5b1a0d4191c53c0a026e2fed483062a0c21814b247"} Oct 30 14:21:32.023732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.023531 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" event={"ID":"1e74d135-83a5-4376-8219-4cd942ee360d","Type":"ContainerStarted","Data":"26972a9626424bbfdeb7f65cb9611697cb6e461a0358d40c36b9f24794015290"} Oct 30 14:21:32.071049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.070944 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podStartSLOduration=1.07093071 podStartE2EDuration="1.07093071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:21:32.069607576 +0000 UTC m=+843.408406585" watchObservedRunningTime="2026-10-30 14:21:32.07093071 +0000 UTC m=+843.409729719" Oct 30 14:21:32.249703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.249669 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:32.484615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.482879 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:32.485138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.484836 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:32.485138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:32.484939 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:33.203606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:33.203575 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:33.474989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:33.474897 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:33.475339 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:33.475310 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:34.247614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:34.247581 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:34.475574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:34.469991 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:34.475574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:34.470047 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:35.477023 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:35.476983 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:35.477762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:35.477727 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:35.926297 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:35.926256 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:36.470036 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:36.469996 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:36.470342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:36.470311 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:36.491586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:36.488018 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:37.478989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:37.478951 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body= Oct 30 14:21:37.479276 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:37.479241 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" Oct 30 14:21:37.730075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:37.729981 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:38.474257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:38.474223 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:38.474772 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:38.474751 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:38.475368 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:38.475350 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:21:39.451164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:39.451106 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:41.135869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:41.135832 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:41.988269 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:41.988237 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:42.816834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:42.816801 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:44.521427 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:44.521398 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:45.753652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:45.753577 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:46.140606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:46.140507 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:47.952504 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:47.952470 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:49.591470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:49.591418 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:50.428970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:50.428941 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:51.230322 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:51.230282 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:52.827887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:52.827846 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:52.964714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:52.964674 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:54.597702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:54.597668 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:56.439190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:56.439154 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:57.707915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:57.707879 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:58.142494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:58.142388 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:21:59.926932 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:21:59.926884 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:01.518382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:01.518356 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:01.846721 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:22:01.846643 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:22:03.236706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:03.236676 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:04.951992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:04.951949 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:06.769950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:06.769912 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:08.582706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:08.582664 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:10.451289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:10.451249 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:12.251509 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:12.251477 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:13.834278 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:13.834233 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:15.442942 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.442852 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:15.664381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.664347 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:22:15.668525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.668501 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.683564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.683534 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-a5ddf3-openshift-default-dockercfg-7z79k\"" Oct 30 14:22:15.700737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.700665 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:22:15.860231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860194 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860415 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860236 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860415 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860260 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvz8\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860415 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860396 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860530 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860441 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860590 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860667 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860651 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860742 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.860814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.860771 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961561 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961619 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961641 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961669 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961686 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961711 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvz8\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961738 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961769 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.961982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.961813 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.962894 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.962765 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.963025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.962963 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.963273 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.963250 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.963373 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.963322 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.963998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.963968 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.965672 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.965619 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.967174 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.967144 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.985971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.985941 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:15.986094 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:15.986067 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvz8\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:16.284087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:16.284009 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:16.607419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:16.607342 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:22:16.611000 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:22:16.610978 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebc99ef_0539_4853_8be2_c2f9571e5363.slice/crio-4b9caced882d89257cfda19bba2880277c4bbb81462c7ed509dd63949c6e2259 WatchSource:0}: Error finding container 4b9caced882d89257cfda19bba2880277c4bbb81462c7ed509dd63949c6e2259: Status 404 returned error can't find the container with id 4b9caced882d89257cfda19bba2880277c4bbb81462c7ed509dd63949c6e2259 Oct 30 14:22:16.613337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:16.613301 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:16.613448 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:16.613384 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:16.613448 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:16.613430 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:17.139573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:17.138912 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:17.348107 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:17.348066 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" event={"ID":"2ebc99ef-0539-4853-8be2-c2f9571e5363","Type":"ContainerStarted","Data":"dd3e1177b8bd33e145c7963b00a919732a10e232654268a9d94cd0c517575ef3"} Oct 30 14:22:17.348330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:17.348137 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" event={"ID":"2ebc99ef-0539-4853-8be2-c2f9571e5363","Type":"ContainerStarted","Data":"4b9caced882d89257cfda19bba2880277c4bbb81462c7ed509dd63949c6e2259"} Oct 30 14:22:17.432047 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:17.431970 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podStartSLOduration=2.431947806 podStartE2EDuration="2.431947806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:22:17.418831493 +0000 UTC m=+888.757630533" watchObservedRunningTime="2026-10-30 14:22:17.431947806 +0000 UTC m=+888.770746813" Oct 30 14:22:18.284772 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:18.284730 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:18.286741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:18.286707 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Oct 30 14:22:18.286882 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:18.286759 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Oct 30 14:22:19.122879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:19.122844 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:19.285049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:19.284976 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Oct 30 14:22:19.285703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:19.285651 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Oct 30 14:22:20.285096 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:20.285059 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Oct 30 14:22:20.285738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:20.285696 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Oct 30 14:22:21.042452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:21.042413 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:21.285083 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:21.285050 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Oct 30 14:22:21.285816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:21.285783 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Oct 30 14:22:22.285020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:22.284981 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body= Oct 30 14:22:22.285321 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:22.285292 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" Oct 30 14:22:22.762626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:22.762590 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:23.476222 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:23.476195 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:23.476683 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:23.476660 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:23.478424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:23.478398 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:22:24.654485 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:24.654449 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:26.122572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:26.122227 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:26.354130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:26.354096 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:28.033463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:28.033422 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:29.705310 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:29.705271 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:31.201813 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.201774 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:22:31.207251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.207229 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.224675 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.224655 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-137f01-openshift-default-dockercfg-wmd9z\"" Oct 30 14:22:31.240637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.240610 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:22:31.309185 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309151 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w594j\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309353 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309194 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309353 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309278 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309353 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309344 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309474 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309516 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309572 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309645 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.309694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.309674 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411125 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411158 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411164 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411204 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411369 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411407 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w594j\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411437 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411481 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411514 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411675 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411718 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.411899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.411845 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.412160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.412128 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.412267 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.412247 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.412432 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.412412 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.413712 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.413690 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.413925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.413904 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.443445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.443414 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.443704 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.443687 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w594j\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.478895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.478811 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:31.521217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.521186 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:31.848161 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.848134 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:22:31.848732 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:22:31.848700 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:22:31.850606 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:22:31.850580 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15bce62_b019_4bd9_8168_7d161b31f045.slice/crio-0b3982826eda9c272d9e2404d59866e9d0662ad756c115a9a61ba96a38c73743 WatchSource:0}: Error finding container 0b3982826eda9c272d9e2404d59866e9d0662ad756c115a9a61ba96a38c73743: Status 404 returned error can't find the container with id 0b3982826eda9c272d9e2404d59866e9d0662ad756c115a9a61ba96a38c73743 Oct 30 14:22:31.852207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.852177 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:31.852281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.852246 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:31.852281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:31.852274 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:22:32.500092 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.500055 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" event={"ID":"a15bce62-b019-4bd9-8168-7d161b31f045","Type":"ContainerStarted","Data":"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593"} Oct 30 14:22:32.500512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.500149 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" event={"ID":"a15bce62-b019-4bd9-8168-7d161b31f045","Type":"ContainerStarted","Data":"0b3982826eda9c272d9e2404d59866e9d0662ad756c115a9a61ba96a38c73743"} Oct 30 14:22:32.521780 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.521744 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:32.527479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.525685 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:32.527479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.525770 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:32.559613 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:32.559534 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podStartSLOduration=1.559517093 podStartE2EDuration="1.559517093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:22:32.55773183 +0000 UTC m=+903.896530853" watchObservedRunningTime="2026-10-30 14:22:32.559517093 +0000 UTC m=+903.898316102" Oct 30 14:22:33.239077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:33.239040 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:33.521812 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:33.521729 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:33.521812 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:33.521791 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:34.522458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:34.522420 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:34.522974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:34.522478 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:35.188294 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:35.188259 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:35.522599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:35.522500 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:35.523067 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:35.522595 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:36.521627 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:36.521584 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:36.521797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:36.521660 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:36.605568 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:36.605509 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:36.988602 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:36.982801 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:37.522319 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:37.522278 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body= Oct 30 14:22:37.522610 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:37.522340 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" Oct 30 14:22:38.812265 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:38.812151 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:38.812908 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:38.812592 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:38.813896 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:38.813874 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:22:39.066430 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:39.066342 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:40.705539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:40.705505 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:42.553811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:42.553768 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:44.702155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:44.702123 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:46.857044 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:46.857006 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:48.514666 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:48.514627 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:50.125561 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:50.125498 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:51.811512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:51.811475 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:53.565190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:53.565148 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:54.250051 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:54.250009 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:54.387439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:54.387393 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:55.233286 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:55.233253 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:57.030752 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:57.030714 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:22:58.629247 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:22:58.629217 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:01.143237 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:01.143202 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:01.846097 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:23:01.846063 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:23:02.800040 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:02.800002 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:02.949999 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:02.949963 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:04.642700 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:04.642662 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:06.416003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:06.415968 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:08.130995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:08.130942 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:08.910897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:08.910863 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj"] Oct 30 14:23:08.915480 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:08.915454 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:08.943021 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:08.942986 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj"] Oct 30 14:23:09.044644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044608 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044719 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044735 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9sjt\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-kube-api-access-f9sjt\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044755 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6985d4d4-559e-489d-a407-d4ef2c0944b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044935 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044855 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044946 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.044998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.044975 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.045071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.045051 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.045106 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.045094 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146250 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146286 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146338 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146374 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146425 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146527 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146570 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9sjt\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-kube-api-access-f9sjt\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146604 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6985d4d4-559e-489d-a407-d4ef2c0944b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.146836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146648 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.147180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.146861 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.147180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.147007 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.147180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.147028 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.147180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.147069 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.147827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.147803 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6985d4d4-559e-489d-a407-d4ef2c0944b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.148758 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.148737 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.149157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.149140 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.170214 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.170185 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.170435 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.170421 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9sjt\" (UniqueName: \"kubernetes.io/projected/6985d4d4-559e-489d-a407-d4ef2c0944b1-kube-api-access-f9sjt\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-296vj\" (UID: \"6985d4d4-559e-489d-a407-d4ef2c0944b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.230730 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.230690 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:09.558052 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.557978 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj"] Oct 30 14:23:09.560611 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:23:09.560582 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6985d4d4_559e_489d_a407_d4ef2c0944b1.slice/crio-b93317b078d1d311cd1290048da2439a36e5d14a230ffd703b98f2884199524b WatchSource:0}: Error finding container b93317b078d1d311cd1290048da2439a36e5d14a230ffd703b98f2884199524b: Status 404 returned error can't find the container with id b93317b078d1d311cd1290048da2439a36e5d14a230ffd703b98f2884199524b Oct 30 14:23:09.562901 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.562867 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:09.562974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.562932 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:09.562974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.562962 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:09.749588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.749504 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:09.855912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.855815 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" event={"ID":"6985d4d4-559e-489d-a407-d4ef2c0944b1","Type":"ContainerStarted","Data":"7e701033dbdc26303eb1d88826304a6ea6119d3ca5301fa5a566cd0f34d52e83"} Oct 30 14:23:09.855912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.855875 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" event={"ID":"6985d4d4-559e-489d-a407-d4ef2c0944b1","Type":"ContainerStarted","Data":"b93317b078d1d311cd1290048da2439a36e5d14a230ffd703b98f2884199524b"} Oct 30 14:23:09.903932 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:09.903883 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podStartSLOduration=1.903868998 podStartE2EDuration="1.903868998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:09.902329452 +0000 UTC m=+941.241128474" watchObservedRunningTime="2026-10-30 14:23:09.903868998 +0000 UTC m=+941.242668008" Oct 30 14:23:10.231869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:10.231837 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:10.233080 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:10.233055 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:10.233200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:10.233104 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:11.231783 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:11.231746 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:11.231964 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:11.231808 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:11.563636 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:11.561184 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:12.231481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:12.231450 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:12.231676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:12.231504 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:13.231974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:13.231933 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:13.232378 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:13.232002 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:13.524222 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:13.524037 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:14.232066 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:14.232033 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:14.232473 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:14.232091 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:15.232039 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:15.231998 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:15.232219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:15.232086 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:15.234566 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:15.234524 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:16.231764 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.231725 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:16.231974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.231788 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:16.667581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.667528 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:23:16.671678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.671656 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.694983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.694959 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-1d36cf-openshift-default-dockercfg-shmkc\"" Oct 30 14:23:16.709376 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.709352 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:23:16.763991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.763962 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.763995 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764150 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764231 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khm9\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764265 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764367 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764383 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764493 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764468 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.764561 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.764513 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.865685 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.865648 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.865875 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.865735 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khm9\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.865875 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.865774 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.865875 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.865851 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866230 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866266 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866326 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866353 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866781 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866491 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866781 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866523 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866781 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866533 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.866781 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866756 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.867011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.866980 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.867107 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.867087 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.868436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.868415 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.868626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.868608 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.889511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.889490 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khm9\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.889634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.889618 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:16.990772 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:16.990682 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:17.030699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.030663 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:17.231753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.231720 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body= Oct 30 14:23:17.231925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.231785 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" Oct 30 14:23:17.335772 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.335697 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:23:17.339295 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:23:17.339262 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fafb4f8_23c4_4ced_802c_8cd561a4ce5d.slice/crio-11ad1bcfc758b84af30cb0648729536d6965d1fec371c80b1f31f86665f4529a WatchSource:0}: Error finding container 11ad1bcfc758b84af30cb0648729536d6965d1fec371c80b1f31f86665f4529a: Status 404 returned error can't find the container with id 11ad1bcfc758b84af30cb0648729536d6965d1fec371c80b1f31f86665f4529a Oct 30 14:23:17.341708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.341675 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:17.341822 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.341738 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:17.341822 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.341767 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:17.936072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.936039 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" event={"ID":"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d","Type":"ContainerStarted","Data":"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07"} Oct 30 14:23:17.936621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.936091 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" event={"ID":"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d","Type":"ContainerStarted","Data":"11ad1bcfc758b84af30cb0648729536d6965d1fec371c80b1f31f86665f4529a"} Oct 30 14:23:17.996715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:17.993634 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:18.002275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.002215 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podStartSLOduration=2.002201573 podStartE2EDuration="2.002201573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:18.000016961 +0000 UTC m=+949.338815997" watchObservedRunningTime="2026-10-30 14:23:18.002201573 +0000 UTC m=+949.341000582" Oct 30 14:23:18.451760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.451710 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:18.452122 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.452091 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:18.453079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.453014 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" Oct 30 14:23:18.993626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.993591 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 30 14:23:18.994089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:18.993662 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 30 14:23:19.092574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:19.088235 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:19.991093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:19.991056 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 30 14:23:19.991280 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:19.991117 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 30 14:23:20.828785 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:20.828746 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:20.991402 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:20.991371 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 30 14:23:20.991621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:20.991420 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 30 14:23:21.784111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:21.784077 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:21.991305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:21.991273 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 30 14:23:21.991723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:21.991326 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 30 14:23:22.811911 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:22.811876 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:22.991724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:22.991682 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body= Oct 30 14:23:22.992187 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:22.991759 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" Oct 30 14:23:24.632782 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:24.632740 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:24.633570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:24.633520 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:24.635097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:24.635077 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:23:24.740500 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:24.740470 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:26.391761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:26.391725 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:26.621728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:26.621700 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:28.422980 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:28.422942 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:30.189632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:30.189602 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:30.731669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:30.731632 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:31.043817 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.043741 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:23:31.048918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.048898 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.076400 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.076365 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:23:31.143046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143004 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143049 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143273 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143161 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143273 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143221 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143365 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143351 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143372 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdz9\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143411 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143477 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.143533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.143510 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.244774 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.244738 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.244783 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.244813 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.244937 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.244976 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245038 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245113 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245212 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245240 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.245270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245265 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdz9\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.246042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245470 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.246042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245706 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.246042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245795 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.246042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.245905 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.247436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.247414 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.247715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.247692 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.270419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.270391 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.272996 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.272971 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdz9\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.364971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.364875 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:31.547843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.547808 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:23:31.552136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.552119 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.588572 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.587816 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:23:31.657841 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.657759 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.657841 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.657815 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.657841 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.657834 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6khc\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658080 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.657913 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658080 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.657952 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658163 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.658130 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.658160 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.658226 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.658312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.658274 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.702020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.701832 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:23:31.705104 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:23:31.705070 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode090260f_c79e_4781_999a_dfa25ea12d1d.slice/crio-ea789dffdde12735684022029cb8b606fbab6787c6b18cdf4c86b8dde7ece415 WatchSource:0}: Error finding container ea789dffdde12735684022029cb8b606fbab6787c6b18cdf4c86b8dde7ece415: Status 404 returned error can't find the container with id ea789dffdde12735684022029cb8b606fbab6787c6b18cdf4c86b8dde7ece415 Oct 30 14:23:31.708701 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.708661 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:31.708816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.708747 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:31.708816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.708791 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:31.759291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759270 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759316 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759335 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6khc\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759353 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759382 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759498 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759530 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759611 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759638 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.759897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.759779 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.760290 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.760265 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.760669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.760638 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.761876 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.761849 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.762205 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.762157 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.762699 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.762679 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.764334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.764315 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.787190 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.787118 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.787598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.787538 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6khc\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:31.853159 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:23:31.853123 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:23:31.870686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:31.870657 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:32.044387 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.044356 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:32.067295 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.066294 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" event={"ID":"e090260f-c79e-4781-999a-dfa25ea12d1d","Type":"ContainerStarted","Data":"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b"} Oct 30 14:23:32.067295 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.066367 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" event={"ID":"e090260f-c79e-4781-999a-dfa25ea12d1d","Type":"ContainerStarted","Data":"ea789dffdde12735684022029cb8b606fbab6787c6b18cdf4c86b8dde7ece415"} Oct 30 14:23:32.118637 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.118575 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podStartSLOduration=1.11853076 podStartE2EDuration="1.11853076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:32.113745405 +0000 UTC m=+963.452544416" watchObservedRunningTime="2026-10-30 14:23:32.11853076 +0000 UTC m=+963.457329771" Oct 30 14:23:32.201603 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.200592 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:23:32.206399 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:23:32.206351 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7fcf23_2283_40b7_ad88_2b2acd640774.slice/crio-898d760840434f7e5af2956edd3966afced87a030b271d4f259a92601ab0c71b WatchSource:0}: Error finding container 898d760840434f7e5af2956edd3966afced87a030b271d4f259a92601ab0c71b: Status 404 returned error can't find the container with id 898d760840434f7e5af2956edd3966afced87a030b271d4f259a92601ab0c71b Oct 30 14:23:32.215574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.212105 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:32.215574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.212178 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:32.215574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.212209 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:23:32.382573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.381865 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:32.386570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.384857 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:32.386570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:32.384914 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:33.110578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.107746 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" event={"ID":"4a7fcf23-2283-40b7-ad88-2b2acd640774","Type":"ContainerStarted","Data":"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3"} Oct 30 14:23:33.110578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.107806 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" event={"ID":"4a7fcf23-2283-40b7-ad88-2b2acd640774","Type":"ContainerStarted","Data":"898d760840434f7e5af2956edd3966afced87a030b271d4f259a92601ab0c71b"} Oct 30 14:23:33.170612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.170529 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podStartSLOduration=2.170507942 podStartE2EDuration="2.170507942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:23:33.16905722 +0000 UTC m=+964.507856270" watchObservedRunningTime="2026-10-30 14:23:33.170507942 +0000 UTC m=+964.509306957" Oct 30 14:23:33.372099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.372002 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:33.372364 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.372334 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:33.883984 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.881927 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:33.905573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.885653 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 30 14:23:33.905573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:33.885710 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 30 14:23:34.021589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:34.015141 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:34.367577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:34.366286 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:34.367577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:34.366343 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:34.875574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:34.871990 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 30 14:23:34.875574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:34.872053 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 30 14:23:35.371575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:35.369607 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:35.371575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:35.369668 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:35.882575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:35.879894 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 30 14:23:35.882575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:35.879958 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 30 14:23:36.117395 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.117364 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:36.367997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.367958 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:36.368260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.368232 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:36.756029 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.755994 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:36.883573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.882727 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 30 14:23:36.883573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:36.882795 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 30 14:23:37.371578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:37.367932 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:37.371578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:37.367994 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:37.873021 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:37.872983 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body= Oct 30 14:23:37.873652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:37.873619 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" Oct 30 14:23:38.207115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:38.207087 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:38.365612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:38.365574 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body= Oct 30 14:23:38.365814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:38.365634 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" Oct 30 14:23:39.031498 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.031458 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:39.032701 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.032671 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:39.033639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.033620 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:23:39.370165 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.370081 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:39.370592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.370540 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:39.371281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.371261 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:23:39.830375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:39.830341 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:41.956833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:41.956787 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:43.952221 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:43.952191 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:45.023866 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:45.023828 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:45.819019 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:45.818981 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:47.460711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:47.460680 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:49.287223 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:49.287181 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:50.405972 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:50.405935 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:51.046847 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:51.046799 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:52.737963 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:52.737918 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:54.732331 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:54.732296 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:56.289510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:56.289476 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:57.883351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:57.883298 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:23:59.635625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:23:59.635594 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:01.249592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:01.249558 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:01.426838 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:01.426802 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:01.848204 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:24:01.848158 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:24:02.997583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:02.997532 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:04.724257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:04.724227 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:04.953428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:04.953395 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:06.340407 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:06.340366 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:06.571942 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:06.571903 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:08.032301 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:08.032263 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:09.747543 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:09.747506 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:11.516285 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:11.516238 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:12.328233 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:12.328204 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:13.213985 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:13.213953 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:14.886886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:14.886853 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:15.787815 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.787779 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:24:15.796846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.796820 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.815986 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.815963 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:24:15.824013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.823988 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"default-dockercfg-nbjrd\"" Oct 30 14:24:15.824013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.823988 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"distinct-2-w0-1d36cf-kserve-self-signed-certs\"" Oct 30 14:24:15.824013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.823997 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"openshift-service-ca.crt\"" Oct 30 14:24:15.824219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.824036 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-1d36cf\"/\"kube-root-ca.crt\"" Oct 30 14:24:15.882716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.882684 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:15.946209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946176 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.946209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946213 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.946678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946237 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.946678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946345 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.946678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946495 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:15.946678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:15.946526 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwqp7\" (UniqueName: \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.047920 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.047982 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048017 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048065 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048224 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048254 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqp7\" (UniqueName: \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048484 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048459 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048473 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.048587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.048501 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.051123 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.051094 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.051840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.051817 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.073321 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.073286 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwqp7\" (UniqueName: \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\") pod \"distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.110981 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.110954 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:16.432238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.432216 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:24:16.435804 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:24:16.435778 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc20aeee1_06aa_419b_95f7_46ad0c7d6534.slice/crio-c903d92e2c6d22735f9d726a0e5c79ceda976a1e3085818d2b75afafcc8f76b0 WatchSource:0}: Error finding container c903d92e2c6d22735f9d726a0e5c79ceda976a1e3085818d2b75afafcc8f76b0: Status 404 returned error can't find the container with id c903d92e2c6d22735f9d726a0e5c79ceda976a1e3085818d2b75afafcc8f76b0 Oct 30 14:24:16.565949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:16.565910 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:17.424513 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:17.424479 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" event={"ID":"c20aeee1-06aa-419b-95f7-46ad0c7d6534","Type":"ContainerStarted","Data":"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41"} Oct 30 14:24:17.425036 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:17.424521 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" event={"ID":"c20aeee1-06aa-419b-95f7-46ad0c7d6534","Type":"ContainerStarted","Data":"c903d92e2c6d22735f9d726a0e5c79ceda976a1e3085818d2b75afafcc8f76b0"} Oct 30 14:24:17.469146 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:17.469095 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" podStartSLOduration=2.469079847 podStartE2EDuration="2.469079847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:24:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:24:17.466426909 +0000 UTC m=+1008.805225916" watchObservedRunningTime="2026-10-30 14:24:17.469079847 +0000 UTC m=+1008.807878874" Oct 30 14:24:18.111523 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:18.111492 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:18.248342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:18.248303 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:19.936384 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:19.936344 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:21.644792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:21.644747 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:23.273586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:23.273516 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:25.020349 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:25.020317 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:26.118351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:26.118317 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:26.173264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:26.166890 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:26.552162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:26.552134 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:24:26.952670 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:26.952631 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:28.815802 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:28.815761 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:30.379757 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:30.379721 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:31.845302 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:24:31.845269 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:24:32.030969 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:32.030923 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:33.750032 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:33.749998 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:35.341351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:35.341314 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:36.869796 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:36.869761 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:37.052033 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:37.051988 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:38.535895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:38.535865 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:38.696681 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:38.696643 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:38.873470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:38.873387 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:40.594520 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:40.594457 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:42.253166 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:42.253128 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:43.953913 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:43.953878 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:45.966855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:45.966820 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:47.633633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:47.633516 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:49.372075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:49.372034 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:50.974498 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:50.974456 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:52.676344 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:52.676307 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:54.240470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:54.240433 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:56.505679 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:56.505495 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:58.299799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:58.299758 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:24:59.881299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:24:59.881260 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:01.278318 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.278284 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:25:01.282925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.282904 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.318394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.318362 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:25:01.363052 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363019 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363239 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363078 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363317 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363292 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363339 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363455 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363433 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363587 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363700 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363657 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt7ht\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363750 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363712 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.363832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.363802 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465165 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465131 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465352 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465183 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465339 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465496 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465482 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465644 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt7ht\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465821 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.465846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465840 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465665 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465901 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.465966 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466035 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.466004 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.466455 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.466488 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.466573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.466464 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.468183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.468161 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.468397 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.468377 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.490164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.490134 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt7ht\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.491285 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.491258 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\") pod \"e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.589916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.589822 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:01.597022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.596997 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:01.824890 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.824857 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:25:01.837876 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.837844 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.847380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.847306 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:25:01.851996 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.851975 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.860464 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:25:01.860428 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:25:01.867653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.867614 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:25:01.875734 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.875700 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:25:01.937457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.937429 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:25:01.941877 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:25:01.941849 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf924ee5b_0870_40b9_b995_50c2d392dd2c.slice/crio-ec5b80965ce5b265be945e6e2fff5114d5b795b8e08768d239314a2086a5836f WatchSource:0}: Error finding container ec5b80965ce5b265be945e6e2fff5114d5b795b8e08768d239314a2086a5836f: Status 404 returned error can't find the container with id ec5b80965ce5b265be945e6e2fff5114d5b795b8e08768d239314a2086a5836f Oct 30 14:25:01.944539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.944507 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:01.944670 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.944593 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:01.944670 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.944622 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:01.977517 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977491 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.977677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977528 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.977677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977582 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.977769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977679 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.977769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977706 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.977769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977744 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqdhz\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.977871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977826 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.977871 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977851 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.977939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977869 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.977939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977896 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.977939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977923 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.978047 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.977950 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.978047 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978022 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.978119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978070 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.978119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978089 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.978119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978114 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m775s\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:01.978315 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978146 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:01.978315 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:01.978192 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079217 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079297 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079333 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079363 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079405 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m775s\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079454 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079479 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079592 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079630 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079656 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079696 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.079797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079739 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079800 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqdhz\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079868 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079896 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079923 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.079965 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.080097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.080005 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.081299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.081264 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.082577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.081909 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.082577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.081950 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.082577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.082183 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.082577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.082464 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.083644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.082909 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.083644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.083056 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.083644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.083308 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.084138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.084013 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.084138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.084098 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.085953 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.085930 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.090383 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.090362 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.090834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.090814 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.091867 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.091844 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.110907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.110826 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m775s\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.110907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.110835 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.111171 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.111149 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.111374 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.111357 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqdhz\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\") pod \"e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.156367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.156337 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:02.178743 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.178705 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:02.490328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.490114 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:25:02.501593 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:25:02.500709 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fd3806_e5ea_47fa_a4f9_2e4c74e4af7c.slice/crio-92cb64700f25560d5863545d6e71346ad71d93b589fa656f62322a138b9022a8 WatchSource:0}: Error finding container 92cb64700f25560d5863545d6e71346ad71d93b589fa656f62322a138b9022a8: Status 404 returned error can't find the container with id 92cb64700f25560d5863545d6e71346ad71d93b589fa656f62322a138b9022a8 Oct 30 14:25:02.504089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.504042 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.504208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.504135 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.504271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.504203 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.526714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.526669 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.526857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.526795 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.526857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.526840 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:02.527002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.526951 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:25:02.814182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.814092 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" event={"ID":"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c","Type":"ContainerStarted","Data":"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56"} Oct 30 14:25:02.814182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.814146 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" event={"ID":"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c","Type":"ContainerStarted","Data":"92cb64700f25560d5863545d6e71346ad71d93b589fa656f62322a138b9022a8"} Oct 30 14:25:02.816060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.816029 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" event={"ID":"f924ee5b-0870-40b9-b995-50c2d392dd2c","Type":"ContainerStarted","Data":"6c2edd52fc176fa471557c29c13b9ea43ec77b5448b585474cd24d6d0e206931"} Oct 30 14:25:02.816196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.816077 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" event={"ID":"f924ee5b-0870-40b9-b995-50c2d392dd2c","Type":"ContainerStarted","Data":"ec5b80965ce5b265be945e6e2fff5114d5b795b8e08768d239314a2086a5836f"} Oct 30 14:25:02.818344 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.818319 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" event={"ID":"64cdcd62-a27d-4933-939d-e25ce3e18a4a","Type":"ContainerStarted","Data":"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53"} Oct 30 14:25:02.818452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.818356 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" event={"ID":"64cdcd62-a27d-4933-939d-e25ce3e18a4a","Type":"ContainerStarted","Data":"18dd67947e15724950f9c525cdaf01664a5d146e37dc6a00b917673ea6351c7e"} Oct 30 14:25:02.886252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.886184 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podStartSLOduration=1.886165246 podStartE2EDuration="1.886165246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:02.883089364 +0000 UTC m=+1054.221888400" watchObservedRunningTime="2026-10-30 14:25:02.886165246 +0000 UTC m=+1054.224964257" Oct 30 14:25:02.932842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:02.932764 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podStartSLOduration=1.932746622 podStartE2EDuration="1.932746622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:02.9313874 +0000 UTC m=+1054.270186412" watchObservedRunningTime="2026-10-30 14:25:02.932746622 +0000 UTC m=+1054.271545633" Oct 30 14:25:03.157000 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.156902 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:03.158304 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.158280 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:03.158405 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.158323 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:03.188574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.186622 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:03.188574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.186791 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:03.188574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.187825 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:03.535297 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.535263 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:03.613639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.613602 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:03.617575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.613989 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:03.617575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:03.614046 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:04.157612 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.157581 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:04.157797 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.157637 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:04.180583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.180049 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:04.180583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.180112 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:04.620626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.608958 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:04.620626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:04.609018 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:05.160574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.157205 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:05.160574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.157260 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:05.202486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.202449 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:05.253763 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.253710 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:05.604408 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.604374 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:05.605111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.605083 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:05.605314 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:05.605291 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:06.156749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.156715 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:06.157159 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.156811 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:06.201576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.201137 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:06.201576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.201205 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:06.599578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.598308 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:06.599578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:06.598395 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:07.156907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.156876 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:07.157479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.157448 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:07.255252 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.255212 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:07.255455 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.255284 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:07.618575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.615741 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:07.618875 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.618839 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:07.948385 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:07.948354 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:08.157084 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.157055 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:08.157535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.157510 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:08.222160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.222054 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:08.222160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.222139 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:08.610629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.609936 5768 patch_prober.go:29] interesting pod/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body= Oct 30 14:25:08.610629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:08.609998 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" Oct 30 14:25:09.157030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.156993 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body= Oct 30 14:25:09.157214 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.157060 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" Oct 30 14:25:09.180060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.180029 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body= Oct 30 14:25:09.180182 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.180089 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" Oct 30 14:25:09.941136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.930761 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:09.941136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.933375 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:09.943045 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:09.941730 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:25:10.001573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.001340 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podStartSLOduration=9.001320813 podStartE2EDuration="9.001320813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:02.995060389 +0000 UTC m=+1054.333859399" watchObservedRunningTime="2026-10-30 14:25:10.001320813 +0000 UTC m=+1061.340119824" Oct 30 14:25:10.194964 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.194863 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:10.489121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.489025 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:10.489950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.489847 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:10.491663 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.491637 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:25:10.531856 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.531822 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:10.532581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.532468 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:10.533341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:10.533316 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:25:11.989164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:11.989118 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:13.668009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:13.667974 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:14.988290 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:14.988249 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:15.363899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:15.363813 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:16.363517 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.363483 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:25:16.367805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.367777 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.402087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.402059 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:25:16.418849 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.418821 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:25:16.423273 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.423250 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.446282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446241 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446448 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446379 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2x48\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446483 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446514 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446581 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446610 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446680 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446730 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.446846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.446783 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.448932 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.448906 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:25:16.548494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548462 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2x48\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.548494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548500 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.548786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548526 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.548786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548635 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.548786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548683 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.548786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548706 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.548786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548752 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548811 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548877 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.548924 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549010 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549085 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549121 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549134 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549138 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549175 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549226 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549233 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549273 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.549522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549296 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549341 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.549828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.549591 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.550026 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.550006 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.551591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.551571 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.551713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.551698 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.572386 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.572355 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2x48\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.572493 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.572476 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.651095 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651006 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651095 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651092 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651171 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651196 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651244 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651377 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651434 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651419 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651481 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651520 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651601 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.651748 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.651626 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.652032 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.652008 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.652121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.652032 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.652267 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.652242 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.655070 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.655044 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.655166 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.655154 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.684298 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.684275 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:16.687141 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.687116 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.687374 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.687359 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\") pod \"e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:16.754135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:16.753818 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:17.007912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.007889 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:25:17.013927 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:25:17.013899 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d911d30_e3dc_4e7c_abff_a07409470c74.slice/crio-b48d25e3eacdb4f225ca578dc502a6bdb4bda863f87d0d05a8100394fc9de657 WatchSource:0}: Error finding container b48d25e3eacdb4f225ca578dc502a6bdb4bda863f87d0d05a8100394fc9de657: Status 404 returned error can't find the container with id b48d25e3eacdb4f225ca578dc502a6bdb4bda863f87d0d05a8100394fc9de657 Oct 30 14:25:17.016308 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.016278 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.016388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.016342 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.016388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.016372 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.060393 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.060365 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" event={"ID":"2d911d30-e3dc-4e7c-abff-a07409470c74","Type":"ContainerStarted","Data":"b48d25e3eacdb4f225ca578dc502a6bdb4bda863f87d0d05a8100394fc9de657"} Oct 30 14:25:17.080345 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.080258 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:25:17.087513 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:25:17.087487 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3fad2b_37a2_4210_81f5_190a5e65ed25.slice/crio-1df9f877470187056f627b6e8b038ab3c4bc0961f8bc8e3611c429905d69147d WatchSource:0}: Error finding container 1df9f877470187056f627b6e8b038ab3c4bc0961f8bc8e3611c429905d69147d: Status 404 returned error can't find the container with id 1df9f877470187056f627b6e8b038ab3c4bc0961f8bc8e3611c429905d69147d Oct 30 14:25:17.089939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.089906 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.090020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.089971 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.090020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.089998 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:25:17.173776 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:17.173738 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:18.116187 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.116147 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" event={"ID":"7d3fad2b-37a2-4210-81f5-190a5e65ed25","Type":"ContainerStarted","Data":"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f"} Oct 30 14:25:18.116625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.116294 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" event={"ID":"7d3fad2b-37a2-4210-81f5-190a5e65ed25","Type":"ContainerStarted","Data":"1df9f877470187056f627b6e8b038ab3c4bc0961f8bc8e3611c429905d69147d"} Oct 30 14:25:18.118108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.118083 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" event={"ID":"2d911d30-e3dc-4e7c-abff-a07409470c74","Type":"ContainerStarted","Data":"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c"} Oct 30 14:25:18.194601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.194263 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podStartSLOduration=2.194243248 podStartE2EDuration="2.194243248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:18.192702317 +0000 UTC m=+1069.531501354" watchObservedRunningTime="2026-10-30 14:25:18.194243248 +0000 UTC m=+1069.533042259" Oct 30 14:25:18.248558 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.248484 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podStartSLOduration=2.24846873 podStartE2EDuration="2.24846873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:25:18.244403298 +0000 UTC m=+1069.583202307" watchObservedRunningTime="2026-10-30 14:25:18.24846873 +0000 UTC m=+1069.587267740" Oct 30 14:25:18.690573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.689580 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:18.690573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.689703 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:18.690573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.689747 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:18.754891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.754858 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:18.756189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.756163 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:18.756377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:18.756357 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:19.058631 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:19.058010 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:19.688575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:19.687886 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:19.688575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:19.687946 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:19.754924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:19.754890 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:19.755202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:19.755175 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:20.083631 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.083131 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:20.688574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.685856 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:20.688574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.685938 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:20.764584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.762942 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:20.764584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.763019 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:20.921179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:20.921128 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:21.550575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.547688 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:21.698574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.696326 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:21.698574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.696395 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:21.758947 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.758910 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:21.759235 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.759206 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:21.968704 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.968660 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:21.969837 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:21.969812 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:25:22.090606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.087499 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:22.138324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.138255 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:25:22.689584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.685904 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:22.689584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.685965 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:22.755245 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.755209 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:22.755650 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:22.755269 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:23.689588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:23.689054 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:23.689588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:23.689128 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:23.755014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:23.754979 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:23.755160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:23.755024 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:24.104205 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:24.104120 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:24.685108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:24.685073 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body= Oct 30 14:25:24.685319 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:24.685134 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" Oct 30 14:25:24.754653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:24.754618 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body= Oct 30 14:25:24.754828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:24.754680 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" Oct 30 14:25:25.704710 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:25.704675 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:25:25.856078 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:25.856045 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:26.023163 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:26.022937 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:26.726805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:26.726720 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:26.726805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:26.726797 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:26.797926 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:26.797892 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:26.798221 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:26.798192 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:27.179497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.179467 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:27.180688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.180593 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:27.183010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.182988 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:25:27.254761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.254729 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:27.255695 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.255673 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:27.256488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.256462 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:25:27.793782 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:27.793735 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:29.613850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:29.613804 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:30.705279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:30.705233 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" containerID="cri-o://0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960" gracePeriod=25 Oct 30 14:25:31.339989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:31.339956 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:31.846845 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:25:31.846808 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:25:32.435840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:32.435805 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 14:25:33.030430 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:33.030382 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:34.662251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:34.662164 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:35.235391 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:35.235359 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:36.655913 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:36.655881 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:37.021165 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:37.021134 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:38.398965 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:38.398873 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:40.319708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:40.319617 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:40.485570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:40.474191 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:41.232042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:41.232008 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:41.591642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:41.571302 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:41.591642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:41.571380 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:41.592463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:41.592325 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:41.592463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:41.592400 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:42.146575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:42.145643 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:42.499575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:42.499037 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 14:25:42.567577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:42.566687 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.162189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.135005 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" podUID="d7f770d8-4f3b-4c56-b862-09475a86e8bc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.162189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.154493 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" probeResult="failure" output="Get \"https://10.134.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.270605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.263030 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:43.270605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.263105 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.281155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.281005 5768 patch_prober.go:29] interesting pod/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:25:43.281155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.281078 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.431279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.431248 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:25:43.432519 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.432502 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:25:43.574903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.573229 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" probeResult="failure" output="Get \"https://10.134.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 14:25:43.576172 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.575673 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:25:43.645145 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.645108 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:25:43.981050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:43.981016 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:45.761581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:45.761536 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:46.010497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:46.010458 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:46.154706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:46.154542 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:46.155971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:46.155949 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:25:46.345443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:46.345412 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:47.727431 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:47.727401 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:49.009780 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.009751 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:25:49.010223 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.009965 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" podUID="af915779-2ae7-46f5-973d-f00bb27e110a" containerName="maas-api" containerID="cri-o://6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8" gracePeriod=30 Oct 30 14:25:49.100737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.100705 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:49.261191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.261096 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:49.600236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.600066 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:49.616400 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.616370 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:25:49.644677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.644644 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\") pod \"af915779-2ae7-46f5-973d-f00bb27e110a\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " Oct 30 14:25:49.644881 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.644714 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\") pod \"af915779-2ae7-46f5-973d-f00bb27e110a\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " Oct 30 14:25:49.644881 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.644797 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\") pod \"af915779-2ae7-46f5-973d-f00bb27e110a\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " Oct 30 14:25:49.644881 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.644872 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\" (UniqueName: \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\") pod \"af915779-2ae7-46f5-973d-f00bb27e110a\" (UID: \"af915779-2ae7-46f5-973d-f00bb27e110a\") " Oct 30 14:25:49.645255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.645228 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca" pod "af915779-2ae7-46f5-973d-f00bb27e110a" (UID: "af915779-2ae7-46f5-973d-f00bb27e110a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:25:49.645443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.645414 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af915779-2ae7-46f5-973d-f00bb27e110a-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:49.647207 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.647182 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls" pod "af915779-2ae7-46f5-973d-f00bb27e110a" (UID: "af915779-2ae7-46f5-973d-f00bb27e110a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:25:49.647326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.647203 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs" pod "af915779-2ae7-46f5-973d-f00bb27e110a" (UID: "af915779-2ae7-46f5-973d-f00bb27e110a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:25:49.647651 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.647629 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7" pod "af915779-2ae7-46f5-973d-f00bb27e110a" (UID: "af915779-2ae7-46f5-973d-f00bb27e110a"). InnerVolumeSpecName "kube-api-access-9ctn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:25:49.746919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.746883 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ctn7\" (UniqueName: \"kubernetes.io/projected/af915779-2ae7-46f5-973d-f00bb27e110a-kube-api-access-9ctn7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:49.746919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.746919 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:49.746919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.746933 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af915779-2ae7-46f5-973d-f00bb27e110a-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:49.747460 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.747435 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:49.758337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.758313 5768 generic.go:356] "Generic (PLEG): container finished" podID="af915779-2ae7-46f5-973d-f00bb27e110a" containerID="6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8" exitCode=0 Oct 30 14:25:49.758486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.758359 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" Oct 30 14:25:49.758486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.758399 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" event={"ID":"af915779-2ae7-46f5-973d-f00bb27e110a","Type":"ContainerDied","Data":"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8"} Oct 30 14:25:49.758486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.758463 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7" event={"ID":"af915779-2ae7-46f5-973d-f00bb27e110a","Type":"ContainerDied","Data":"290853774f3a32ae90da3252cfe45759c17a8cf842c7fd3af0a72675e5f49353"} Oct 30 14:25:49.758688 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.758487 5768 scope.go:122] "RemoveContainer" containerID="6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8" Oct 30 14:25:49.770796 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.770773 5768 scope.go:122] "RemoveContainer" containerID="6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8" Oct 30 14:25:49.771072 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:25:49.771054 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8\": container with ID starting with 6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8 not found: ID does not exist" containerID="6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8" Oct 30 14:25:49.771137 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.771082 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8"} err="failed to get container status \"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8\": rpc error: code = NotFound desc = could not find container \"6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8\": container with ID starting with 6012f54c87171cb21fd313e1b3952e6fbad2180eb63bdddaa441d5cf50424cb8 not found: ID does not exist" Oct 30 14:25:49.815632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.815599 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:25:49.819685 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.819653 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-a5ddf3-b45f84787-8f4q7"] Oct 30 14:25:49.896033 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:49.895941 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:50.355676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:50.355643 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:50.506017 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:50.505978 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:50.783530 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:50.783495 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af915779-2ae7-46f5-973d-f00bb27e110a" path="/var/lib/kubelet/pods/af915779-2ae7-46f5-973d-f00bb27e110a/volumes" Oct 30 14:25:51.005737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.005709 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:25:51.065149 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.065113 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\") pod \"7703b483-7e39-4a3f-bded-ae434c8f0345\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " Oct 30 14:25:51.065340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.065319 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\" (UniqueName: \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\") pod \"7703b483-7e39-4a3f-bded-ae434c8f0345\" (UID: \"7703b483-7e39-4a3f-bded-ae434c8f0345\") " Oct 30 14:25:51.065622 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.065594 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume" pod "7703b483-7e39-4a3f-bded-ae434c8f0345" (UID: "7703b483-7e39-4a3f-bded-ae434c8f0345"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:25:51.065884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.065864 5768 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7703b483-7e39-4a3f-bded-ae434c8f0345-plugins-config-volume\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:51.067711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.067690 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr" pod "7703b483-7e39-4a3f-bded-ae434c8f0345" (UID: "7703b483-7e39-4a3f-bded-ae434c8f0345"). InnerVolumeSpecName "kube-api-access-l5glr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:25:51.118791 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.118751 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:51.167043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.167010 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5glr\" (UniqueName: \"kubernetes.io/projected/7703b483-7e39-4a3f-bded-ae434c8f0345-kube-api-access-l5glr\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:25:51.277853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.277764 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:51.689574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.689531 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:51.775482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.775450 5768 generic.go:356] "Generic (PLEG): container finished" podID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerID="0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960" exitCode=0 Oct 30 14:25:51.775728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.775489 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" event={"ID":"7703b483-7e39-4a3f-bded-ae434c8f0345","Type":"ContainerDied","Data":"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960"} Oct 30 14:25:51.775728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.775507 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" Oct 30 14:25:51.775728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.775526 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8" event={"ID":"7703b483-7e39-4a3f-bded-ae434c8f0345","Type":"ContainerDied","Data":"5b01ed4ba9c708afcbe41d705955e9a9d25efdf49e750648944411a9d366b716"} Oct 30 14:25:51.775728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.775563 5768 scope.go:122] "RemoveContainer" containerID="0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960" Oct 30 14:25:51.785757 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.785740 5768 scope.go:122] "RemoveContainer" containerID="0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960" Oct 30 14:25:51.786065 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:25:51.786044 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960\": container with ID starting with 0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960 not found: ID does not exist" containerID="0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960" Oct 30 14:25:51.786124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.786072 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960"} err="failed to get container status \"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960\": rpc error: code = NotFound desc = could not find container \"0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960\": container with ID starting with 0c4d17aaf6a84d9a860dd86d0866f5148144f512cc570f3bc9a31f2f37b3b960 not found: ID does not exist" Oct 30 14:25:51.843518 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.843492 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:25:51.858124 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:51.858097 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-a5ddf3-746d5b647f-7c9r8"] Oct 30 14:25:52.253078 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:52.253028 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:52.421622 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:52.421525 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:52.819579 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:52.814947 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" path="/var/lib/kubelet/pods/7703b483-7e39-4a3f-bded-ae434c8f0345/volumes" Oct 30 14:25:53.660807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:53.660762 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:55.265326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:55.265290 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:55.588478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:55.588389 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:57.088287 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:57.088255 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:57.770338 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:57.770308 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:57.941363 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:57.941328 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:58.874561 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:58.874512 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:59.503365 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.503328 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:59.656842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.656806 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:59.792676 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.792579 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:25:59.792932 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.792901 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" containerID="cri-o://dd3e1177b8bd33e145c7963b00a919732a10e232654268a9d94cd0c517575ef3" gracePeriod=30 Oct 30 14:25:59.798648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.798626 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:25:59.798962 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.798937 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" containerID="cri-o://6c2edd52fc176fa471557c29c13b9ea43ec77b5448b585474cd24d6d0e206931" gracePeriod=30 Oct 30 14:25:59.835125 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.835085 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:25:59.981203 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:25:59.981170 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:00.807003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:00.806932 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:01.182387 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.182347 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" containerID="cri-o://9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41" gracePeriod=45 Oct 30 14:26:01.242271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.242243 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:01.394050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.393981 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:01.468975 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.468946 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:26:01.611964 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.611923 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612066 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612219 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612187 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\" (UniqueName: \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612215 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:01.612274 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612247 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612368 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612295 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\" (UniqueName: \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612368 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612338 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\") pod \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\" (UID: \"c20aeee1-06aa-419b-95f7-46ad0c7d6534\") " Oct 30 14:26:01.612511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612480 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:01.612717 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.612691 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:01.613128 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.613106 5768 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tmp-dir\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.613209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.613134 5768 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-home\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.613209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.613147 5768 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-model-cache\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.614682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.614653 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "kube-api-access-hwqp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:01.614682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.614663 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:01.615380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.615355 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs" pod "c20aeee1-06aa-419b-95f7-46ad0c7d6534" (UID: "c20aeee1-06aa-419b-95f7-46ad0c7d6534"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:01.714406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.714324 5768 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c20aeee1-06aa-419b-95f7-46ad0c7d6534-dshm\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.714406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.714353 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwqp7\" (UniqueName: \"kubernetes.io/projected/c20aeee1-06aa-419b-95f7-46ad0c7d6534-kube-api-access-hwqp7\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.714406 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.714363 5768 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c20aeee1-06aa-419b-95f7-46ad0c7d6534-tls-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:01.865887 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:01.865846 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:26:01.889614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.889162 5768 generic.go:356] "Generic (PLEG): container finished" podID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerID="9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41" exitCode=0 Oct 30 14:26:01.889614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.889220 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" event={"ID":"c20aeee1-06aa-419b-95f7-46ad0c7d6534","Type":"ContainerDied","Data":"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41"} Oct 30 14:26:01.889614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.889253 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" event={"ID":"c20aeee1-06aa-419b-95f7-46ad0c7d6534","Type":"ContainerDied","Data":"c903d92e2c6d22735f9d726a0e5c79ceda976a1e3085818d2b75afafcc8f76b0"} Oct 30 14:26:01.889614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.889276 5768 scope.go:122] "RemoveContainer" containerID="9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41" Oct 30 14:26:01.889614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.889434 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr" Oct 30 14:26:01.962411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.961518 5768 scope.go:122] "RemoveContainer" containerID="9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41" Oct 30 14:26:01.962411 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:01.962199 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41\": container with ID starting with 9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41 not found: ID does not exist" containerID="9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41" Oct 30 14:26:01.962411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.962227 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41"} err="failed to get container status \"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41\": rpc error: code = NotFound desc = could not find container \"9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41\": container with ID starting with 9115504df04b4fc50396ed76df3cf7ceef61f5250c05feb1b83cb274e3179c41 not found: ID does not exist" Oct 30 14:26:01.972642 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.966826 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:26:01.981608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:01.981211 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-1d36cf/distinct-2-w0-1d36cf-kserve-848db7f55-lmcpr"] Oct 30 14:26:02.533943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:02.533903 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:02.797329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:02.797254 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" path="/var/lib/kubelet/pods/c20aeee1-06aa-419b-95f7-46ad0c7d6534/volumes" Oct 30 14:26:04.823744 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:04.823586 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:04.937414 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:04.937372 5768 generic.go:356] "Generic (PLEG): container finished" podID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerID="dd3e1177b8bd33e145c7963b00a919732a10e232654268a9d94cd0c517575ef3" exitCode=0 Oct 30 14:26:04.937643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:04.937626 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" event={"ID":"2ebc99ef-0539-4853-8be2-c2f9571e5363","Type":"ContainerDied","Data":"dd3e1177b8bd33e145c7963b00a919732a10e232654268a9d94cd0c517575ef3"} Oct 30 14:26:04.939327 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:04.939304 5768 generic.go:356] "Generic (PLEG): container finished" podID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerID="6c2edd52fc176fa471557c29c13b9ea43ec77b5448b585474cd24d6d0e206931" exitCode=0 Oct 30 14:26:04.939471 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:04.939335 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" event={"ID":"f924ee5b-0870-40b9-b995-50c2d392dd2c","Type":"ContainerDied","Data":"6c2edd52fc176fa471557c29c13b9ea43ec77b5448b585474cd24d6d0e206931"} Oct 30 14:26:05.095121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.095098 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:26:05.123254 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.123225 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:26:05.183074 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183044 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183085 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183115 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183188 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183256 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.183410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183298 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183542 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.183801 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183600 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.183924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183602 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:05.183924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183782 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183854 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.183924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183620 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.183924 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183768 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183941 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183972 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.183980 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184013 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\") pod \"f924ee5b-0870-40b9-b995-50c2d392dd2c\" (UID: \"f924ee5b-0870-40b9-b995-50c2d392dd2c\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184045 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184136 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184176 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184207 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184253 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184260 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:05.184468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184287 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\") pod \"2ebc99ef-0539-4853-8be2-c2f9571e5363\" (UID: \"2ebc99ef-0539-4853-8be2-c2f9571e5363\") " Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184579 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.184952 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185038 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f924ee5b-0870-40b9-b995-50c2d392dd2c-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185059 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185073 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185088 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185102 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185116 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ebc99ef-0539-4853-8be2-c2f9571e5363-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185129 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.185419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185329 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.185671 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185500 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.186015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.185992 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "kube-api-access-sjvz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:05.186117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.186081 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:05.187151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.187101 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:05.187527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.187382 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:05.187527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.187468 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:05.187934 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.187904 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.188116 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.188098 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy" pod "2ebc99ef-0539-4853-8be2-c2f9571e5363" (UID: "2ebc99ef-0539-4853-8be2-c2f9571e5363"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:05.188685 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.188666 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht" pod "f924ee5b-0870-40b9-b995-50c2d392dd2c" (UID: "f924ee5b-0870-40b9-b995-50c2d392dd2c"). InnerVolumeSpecName "kube-api-access-mt7ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:05.286422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286384 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt7ht\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-kube-api-access-mt7ht\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286427 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjvz8\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-kube-api-access-sjvz8\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286448 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286462 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286477 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f924ee5b-0870-40b9-b995-50c2d392dd2c-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286490 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286504 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286518 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286530 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286543 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.286693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.286572 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ebc99ef-0539-4853-8be2-c2f9571e5363-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:05.946779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.946745 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" Oct 30 14:26:05.946779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.946764 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm" event={"ID":"f924ee5b-0870-40b9-b995-50c2d392dd2c","Type":"ContainerDied","Data":"ec5b80965ce5b265be945e6e2fff5114d5b795b8e08768d239314a2086a5836f"} Oct 30 14:26:05.947335 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.946850 5768 scope.go:122] "RemoveContainer" containerID="6c2edd52fc176fa471557c29c13b9ea43ec77b5448b585474cd24d6d0e206931" Oct 30 14:26:05.948447 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.948415 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" event={"ID":"2ebc99ef-0539-4853-8be2-c2f9571e5363","Type":"ContainerDied","Data":"4b9caced882d89257cfda19bba2880277c4bbb81462c7ed509dd63949c6e2259"} Oct 30 14:26:05.948533 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.948486 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96" Oct 30 14:26:05.959634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:05.959619 5768 scope.go:122] "RemoveContainer" containerID="dd3e1177b8bd33e145c7963b00a919732a10e232654268a9d94cd0c517575ef3" Oct 30 14:26:06.037436 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.037399 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:26:06.040293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.040271 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-bh4sm"] Oct 30 14:26:06.083779 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.083700 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:26:06.090099 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.090072 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-a5ddf3-openshift-default-5fdbbf8547-zlb96"] Oct 30 14:26:06.333306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.333276 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:06.784290 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.784259 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" path="/var/lib/kubelet/pods/2ebc99ef-0539-4853-8be2-c2f9571e5363/volumes" Oct 30 14:26:06.784846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:06.784831 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" path="/var/lib/kubelet/pods/f924ee5b-0870-40b9-b995-50c2d392dd2c/volumes" Oct 30 14:26:07.260289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:07.260255 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:07.946065 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:07.946028 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:09.673764 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:09.673734 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:11.001045 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.001007 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:26:11.002784 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.002752 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" podUID="a2526bc5-2127-444e-adc0-eaf08f1b6245" containerName="maas-api" containerID="cri-o://e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114" gracePeriod=30 Oct 30 14:26:11.090447 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.090412 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:11.368136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.368110 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.477650 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\") pod \"a2526bc5-2127-444e-adc0-eaf08f1b6245\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.477696 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\") pod \"a2526bc5-2127-444e-adc0-eaf08f1b6245\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.477845 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\" (UniqueName: \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\") pod \"a2526bc5-2127-444e-adc0-eaf08f1b6245\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.478020 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\") pod \"a2526bc5-2127-444e-adc0-eaf08f1b6245\" (UID: \"a2526bc5-2127-444e-adc0-eaf08f1b6245\") " Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.479314 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca" pod "a2526bc5-2127-444e-adc0-eaf08f1b6245" (UID: "a2526bc5-2127-444e-adc0-eaf08f1b6245"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.482360 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc" pod "a2526bc5-2127-444e-adc0-eaf08f1b6245" (UID: "a2526bc5-2127-444e-adc0-eaf08f1b6245"). InnerVolumeSpecName "kube-api-access-rrsjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:11.502611 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.488372 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs" pod "a2526bc5-2127-444e-adc0-eaf08f1b6245" (UID: "a2526bc5-2127-444e-adc0-eaf08f1b6245"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:11.508730 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.508682 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls" pod "a2526bc5-2127-444e-adc0-eaf08f1b6245" (UID: "a2526bc5-2127-444e-adc0-eaf08f1b6245"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:11.580024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.579910 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrsjc\" (UniqueName: \"kubernetes.io/projected/a2526bc5-2127-444e-adc0-eaf08f1b6245-kube-api-access-rrsjc\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:11.580024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.579950 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:11.580024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.579965 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2526bc5-2127-444e-adc0-eaf08f1b6245-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:11.580024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.579978 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2526bc5-2127-444e-adc0-eaf08f1b6245-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:11.615722 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.615642 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:11.781573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.770751 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:11.995929 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.995902 5768 generic.go:356] "Generic (PLEG): container finished" podID="a2526bc5-2127-444e-adc0-eaf08f1b6245" containerID="e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114" exitCode=0 Oct 30 14:26:11.996117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.995945 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" event={"ID":"a2526bc5-2127-444e-adc0-eaf08f1b6245","Type":"ContainerDied","Data":"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114"} Oct 30 14:26:11.996117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.995958 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" Oct 30 14:26:11.996117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.995991 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5" event={"ID":"a2526bc5-2127-444e-adc0-eaf08f1b6245","Type":"ContainerDied","Data":"5332450fd1c3b5d2497a808389cb185c9f08ce8949b21ab210452960e7fd5c7d"} Oct 30 14:26:11.996117 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:11.996013 5768 scope.go:122] "RemoveContainer" containerID="e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114" Oct 30 14:26:12.007015 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.006844 5768 scope.go:122] "RemoveContainer" containerID="e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114" Oct 30 14:26:12.007291 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:12.007182 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114\": container with ID starting with e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114 not found: ID does not exist" containerID="e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114" Oct 30 14:26:12.007291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.007208 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114"} err="failed to get container status \"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114\": rpc error: code = NotFound desc = could not find container \"e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114\": container with ID starting with e83613099e0219840fe91fb4fb1d4dafab1f24c1bc8366ee28309b68a4f21114 not found: ID does not exist" Oct 30 14:26:12.049154 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.049130 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:26:12.060635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.060613 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-24dfd7-9d4d5bc74-qsxn5"] Oct 30 14:26:12.226760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.226727 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:12.783302 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:12.783273 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2526bc5-2127-444e-adc0-eaf08f1b6245" path="/var/lib/kubelet/pods/a2526bc5-2127-444e-adc0-eaf08f1b6245/volumes" Oct 30 14:26:13.234659 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:13.234628 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:26:13.235151 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:13.234885 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" podUID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" containerName="maas-api" containerID="cri-o://c41b1878ce04b7ce50df2e77db0a7ab8b4b3481094857105ebc7286735c41e17" gracePeriod=30 Oct 30 14:26:13.320847 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:13.320816 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:14.234502 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.202357 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:14.234502 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.213874 5768 generic.go:356] "Generic (PLEG): container finished" podID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" containerID="c41b1878ce04b7ce50df2e77db0a7ab8b4b3481094857105ebc7286735c41e17" exitCode=0 Oct 30 14:26:14.234502 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.214029 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" event={"ID":"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30","Type":"ContainerDied","Data":"c41b1878ce04b7ce50df2e77db0a7ab8b4b3481094857105ebc7286735c41e17"} Oct 30 14:26:14.255382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.255063 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:26:14.380639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.380392 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\") pod \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " Oct 30 14:26:14.380639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.380502 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\") pod \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " Oct 30 14:26:14.382271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.380910 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\") pod \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " Oct 30 14:26:14.382271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.380984 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\" (UniqueName: \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\") pod \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\" (UID: \"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30\") " Oct 30 14:26:14.393891 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.393865 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:14.398087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.398049 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca" pod "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" (UID: "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:14.483807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.483773 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:14.642741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.624619 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d" pod "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" (UID: "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30"). InnerVolumeSpecName "kube-api-access-c824d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:14.667692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.624985 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls" pod "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" (UID: "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:14.667882 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.626146 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs" pod "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" (UID: "4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:14.667989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.648506 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:14.731574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.730595 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:14.731574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.730631 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:14.731574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.730648 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c824d\" (UniqueName: \"kubernetes.io/projected/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30-kube-api-access-c824d\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:14.816730 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:14.816693 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:15.282220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:15.281890 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" event={"ID":"4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30","Type":"ContainerDied","Data":"ba3aa27bf7ae941b52e4960efddc3483c53790fdc68d0cee1be89b2b30923082"} Oct 30 14:26:15.282220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:15.281984 5768 scope.go:122] "RemoveContainer" containerID="c41b1878ce04b7ce50df2e77db0a7ab8b4b3481094857105ebc7286735c41e17" Oct 30 14:26:15.285601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:15.285585 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph" Oct 30 14:26:15.423815 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:15.423793 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:26:15.438937 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:15.438902 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1d36cf-786ff96dbf-94xph"] Oct 30 14:26:16.785417 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:16.785388 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" path="/var/lib/kubelet/pods/4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30/volumes" Oct 30 14:26:16.880951 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:16.880914 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:17.024615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.024542 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:17.122468 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.122377 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:26:17.123259 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123224 5768 cpu_manager.go:414] "containerMap: removing container" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" Oct 30 14:26:17.123259 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123255 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123271 5768 cpu_manager.go:414] "containerMap: removing container" podUID="a2526bc5-2127-444e-adc0-eaf08f1b6245" containerName="maas-api" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123278 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2526bc5-2127-444e-adc0-eaf08f1b6245" containerName="maas-api" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123303 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123309 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123327 5768 cpu_manager.go:414] "containerMap: removing container" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123333 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123349 5768 cpu_manager.go:414] "containerMap: removing container" podUID="af915779-2ae7-46f5-973d-f00bb27e110a" containerName="maas-api" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123355 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af915779-2ae7-46f5-973d-f00bb27e110a" containerName="maas-api" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123368 5768 cpu_manager.go:414] "containerMap: removing container" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123374 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123386 5768 cpu_manager.go:414] "containerMap: removing container" podUID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" containerName="maas-api" Oct 30 14:26:17.123461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123393 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" containerName="maas-api" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123570 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="7703b483-7e39-4a3f-bded-ae434c8f0345" containerName="payload-pre-processing" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123587 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2526bc5-2127-444e-adc0-eaf08f1b6245" containerName="maas-api" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123601 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ebc99ef-0539-4853-8be2-c2f9571e5363" containerName="istio-proxy" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123610 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="f924ee5b-0870-40b9-b995-50c2d392dd2c" containerName="istio-proxy" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123622 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="af915779-2ae7-46f5-973d-f00bb27e110a" containerName="maas-api" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123631 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="c20aeee1-06aa-419b-95f7-46ad0c7d6534" containerName="main" Oct 30 14:26:17.124049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.123640 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d36f6b7-28e1-4cbc-a319-93c0c5cc8b30" containerName="maas-api" Oct 30 14:26:17.128617 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.128596 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.144460 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8s22s\"" Oct 30 14:26:17.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.144439 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 30 14:26:17.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.144505 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 30 14:26:17.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.144532 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 30 14:26:17.163262 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.163229 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:26:17.228019 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.227992 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228034 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228100 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228217 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2w6f\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228258 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228278 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.228330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.228306 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.257443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.257417 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:17.261507 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.261486 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.288944 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.288915 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:17.329040 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329007 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzjhr\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329181 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329052 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329181 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329122 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2w6f\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329177 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329207 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329235 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329296 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329326 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329367 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329393 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329668 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329643 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329710 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329741 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.329787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329771 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329811 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.329920 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.329866 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.330652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.330618 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.331889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.331861 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.331889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.331874 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.332389 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.332368 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.332722 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.332704 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.357542 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.357519 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.357921 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.357900 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2w6f\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4kzxc\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.431401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431370 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431413 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzjhr\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431448 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431474 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431516 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431564 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431597 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431709 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.431833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431747 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.432016 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.431988 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.432118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.432096 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.432177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.432122 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.432177 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.432158 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.432447 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.432315 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.433907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.433886 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.434186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.434169 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.446060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.446042 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:17.454919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.454896 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.455449 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.455423 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzjhr\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\") pod \"e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.580243 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.580209 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:17.769231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.769154 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:26:17.772434 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:26:17.772402 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a627b5_847d_4bf4_a1e4_91c318ed08a9.slice/crio-72ede65dcbf7faf63b126de28a3530b81af7c649dd4c80d413792e22631d1742 WatchSource:0}: Error finding container 72ede65dcbf7faf63b126de28a3530b81af7c649dd4c80d413792e22631d1742: Status 404 returned error can't find the container with id 72ede65dcbf7faf63b126de28a3530b81af7c649dd4c80d413792e22631d1742 Oct 30 14:26:17.774534 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.774517 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:26:17.910512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.910485 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:17.913435 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:26:17.913401 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67599d04_2db7_44a4_afe5_5c921aa11ea1.slice/crio-000766fe6b9705320cdeaa37f648a04dfddbc44446b27db46743a17b32f61fa1 WatchSource:0}: Error finding container 000766fe6b9705320cdeaa37f648a04dfddbc44446b27db46743a17b32f61fa1: Status 404 returned error can't find the container with id 000766fe6b9705320cdeaa37f648a04dfddbc44446b27db46743a17b32f61fa1 Oct 30 14:26:17.916394 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.916356 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:17.916467 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.916426 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:17.916467 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:17.916454 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:18.322628 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.322592 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" event={"ID":"b4a627b5-847d-4bf4-a1e4-91c318ed08a9","Type":"ContainerStarted","Data":"72ede65dcbf7faf63b126de28a3530b81af7c649dd4c80d413792e22631d1742"} Oct 30 14:26:18.324263 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.324237 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" event={"ID":"67599d04-2db7-44a4-afe5-5c921aa11ea1","Type":"ContainerStarted","Data":"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10"} Oct 30 14:26:18.324383 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.324281 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" event={"ID":"67599d04-2db7-44a4-afe5-5c921aa11ea1","Type":"ContainerStarted","Data":"000766fe6b9705320cdeaa37f648a04dfddbc44446b27db46743a17b32f61fa1"} Oct 30 14:26:18.372398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.372320 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podStartSLOduration=1.372306014 podStartE2EDuration="1.372306014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:18.370777476 +0000 UTC m=+1129.709576509" watchObservedRunningTime="2026-10-30 14:26:18.372306014 +0000 UTC m=+1129.711105023" Oct 30 14:26:18.457043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.457001 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:26:18.457266 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.457243 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" podUID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" containerName="maas-api" containerID="cri-o://d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6" gracePeriod=30 Oct 30 14:26:18.553064 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.553027 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:18.584713 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.584627 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:18.585351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.585323 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body= Oct 30 14:26:18.585413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:18.585387 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" Oct 30 14:26:19.195663 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.195529 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:19.247392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.247367 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:26:19.295606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.294989 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\" (UniqueName: \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\") pod \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " Oct 30 14:26:19.295606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.295150 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") pod \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " Oct 30 14:26:19.295606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.295257 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\") pod \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " Oct 30 14:26:19.295606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.295311 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\") pod \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\" (UID: \"055c54ab-de2a-4f20-aefa-21a47b5fdbf4\") " Oct 30 14:26:19.296994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.296179 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca" pod "055c54ab-de2a-4f20-aefa-21a47b5fdbf4" (UID: "055c54ab-de2a-4f20-aefa-21a47b5fdbf4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:19.299976 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.299954 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z" pod "055c54ab-de2a-4f20-aefa-21a47b5fdbf4" (UID: "055c54ab-de2a-4f20-aefa-21a47b5fdbf4"). InnerVolumeSpecName "kube-api-access-zzt5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:19.304680 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.304655 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs" pod "055c54ab-de2a-4f20-aefa-21a47b5fdbf4" (UID: "055c54ab-de2a-4f20-aefa-21a47b5fdbf4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:19.305875 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.305827 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls" pod "055c54ab-de2a-4f20-aefa-21a47b5fdbf4" (UID: "055c54ab-de2a-4f20-aefa-21a47b5fdbf4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:26:19.335414 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.335302 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:19.336927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.336901 5768 generic.go:356] "Generic (PLEG): container finished" podID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" containerID="d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6" exitCode=0 Oct 30 14:26:19.337060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.337044 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" Oct 30 14:26:19.338032 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.338003 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" event={"ID":"055c54ab-de2a-4f20-aefa-21a47b5fdbf4","Type":"ContainerDied","Data":"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6"} Oct 30 14:26:19.338139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.338068 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb" event={"ID":"055c54ab-de2a-4f20-aefa-21a47b5fdbf4","Type":"ContainerDied","Data":"f02a5a8505201c229db8b673d9e501cb313384cd452ceb4bc3230bfd710d363a"} Oct 30 14:26:19.338139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.338102 5768 scope.go:122] "RemoveContainer" containerID="d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6" Oct 30 14:26:19.358047 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.357641 5768 scope.go:122] "RemoveContainer" containerID="d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6" Oct 30 14:26:19.359244 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:19.358173 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6\": container with ID starting with d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6 not found: ID does not exist" containerID="d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6" Oct 30 14:26:19.359244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.358202 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6"} err="failed to get container status \"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6\": rpc error: code = NotFound desc = could not find container \"d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6\": container with ID starting with d304b39b05f392019fea8692b6407839de7693e3ce8552cd83238e3baaffecd6 not found: ID does not exist" Oct 30 14:26:19.396653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.396593 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:19.396653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.396625 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:19.396653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.396639 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:19.396653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.396653 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzt5z\" (UniqueName: \"kubernetes.io/projected/055c54ab-de2a-4f20-aefa-21a47b5fdbf4-kube-api-access-zzt5z\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:19.413121 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.413078 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:26:19.418288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.418109 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-bf8266-5dd8cff756-wz7sb"] Oct 30 14:26:19.534008 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.533975 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:19.589503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.588969 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body= Oct 30 14:26:19.589503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.589031 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" Oct 30 14:26:19.909360 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:19.909268 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:20.591599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:20.585952 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body= Oct 30 14:26:20.591599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:20.586012 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" Oct 30 14:26:20.724345 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:20.724265 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:20.810647 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:20.810170 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" path="/var/lib/kubelet/pods/055c54ab-de2a-4f20-aefa-21a47b5fdbf4/volumes" Oct 30 14:26:20.912652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:20.908825 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:21.123575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.121154 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:21.262629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.205875 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:26:21.262629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.206216 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" containerID="cri-o://7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56" gracePeriod=30 Oct 30 14:26:21.471329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.331910 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:21.595634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.588611 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body= Oct 30 14:26:21.595634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.588707 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" Oct 30 14:26:21.660577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.605349 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:26:21.660577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.655785 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" containerID="cri-o://d69337f1bff39d2853fa1c5b1a0d4191c53c0a026e2fed483062a0c21814b247" gracePeriod=30 Oct 30 14:26:21.727926 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.727892 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:26:21.728463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.728415 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" containerID="cri-o://36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3" gracePeriod=30 Oct 30 14:26:21.820842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.820805 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:26:21.821074 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.821050 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" containerID="cri-o://47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53" gracePeriod=30 Oct 30 14:26:21.938751 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:21.938718 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:22.044808 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.044053 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq" podUID="d7f770d8-4f3b-4c56-b862-09475a86e8bc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 14:26:22.149160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.149127 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:22.656576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.631914 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body= Oct 30 14:26:22.752180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.752136 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" Oct 30 14:26:22.752798 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.658628 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:22.841343 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.841314 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:22.841700 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.841607 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:26:22.842068 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.842038 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" containerID="cri-o://f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07" gracePeriod=30 Oct 30 14:26:22.842960 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.842596 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" containerID="cri-o://e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10" gracePeriod=30 Oct 30 14:26:22.947261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:22.946626 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:23.490662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:23.490611 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 14:26:23.490945 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:23.490672 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:26:23.835071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:23.834935 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:24.035058 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.035026 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 14:26:24.035238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.035077 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:26:24.194571 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.193715 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:24.351221 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.351184 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:24.636243 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.636163 5768 patch_prober.go:29] interesting pod/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 14:26:24.636243 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.636223 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:26:24.898834 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.898798 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:24.899147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:24.898868 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:25.028498 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.028452 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:25.493786 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.493751 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Oct 30 14:26:25.493989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.493810 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:26:25.536037 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.535996 5768 patch_prober.go:29] interesting pod/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 14:26:25.536224 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.536059 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:26:25.652574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.651889 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:25.808755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.808650 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" event={"ID":"b4a627b5-847d-4bf4-a1e4-91c318ed08a9","Type":"ContainerStarted","Data":"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d"} Oct 30 14:26:25.808955 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.808884 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:25.880709 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:25.880638 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" podStartSLOduration=1.757648549 podStartE2EDuration="8.880617659s" totalImagesPullingTime="7.12296911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:25.865421614 +0000 UTC m=+1137.204220642" watchObservedRunningTime="2026-10-30 14:26:25.880617659 +0000 UTC m=+1137.219416685" Oct 30 14:26:26.528119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.528058 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:26.578973 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.578944 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:26:26.653464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653368 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.653654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653460 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.653807 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653774 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:26.653948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653846 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.653948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653875 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.653948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653895 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.653948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653949 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.654206 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653969 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:26.654206 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.653988 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.654206 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654112 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.654206 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654162 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\") pod \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\" (UID: \"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c\") " Oct 30 14:26:26.654886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654651 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.654886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654676 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.654886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654652 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:26.654886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654825 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:26.654886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.654850 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:26.656855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.656832 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:26.657678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.657653 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:26.657678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.657669 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:26.662093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.662066 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s" pod "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" (UID: "d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c"). InnerVolumeSpecName "kube-api-access-m775s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:26.755879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755848 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.755879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755876 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.755879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755884 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.756162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755894 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.756162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755905 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.756162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755918 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m775s\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-kube-api-access-m775s\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.756162 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.755926 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.830215 5768 generic.go:356] "Generic (PLEG): container finished" podID="1e74d135-83a5-4376-8219-4cd942ee360d" containerID="d69337f1bff39d2853fa1c5b1a0d4191c53c0a026e2fed483062a0c21814b247" exitCode=0 Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.830302 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" event={"ID":"1e74d135-83a5-4376-8219-4cd942ee360d","Type":"ContainerDied","Data":"d69337f1bff39d2853fa1c5b1a0d4191c53c0a026e2fed483062a0c21814b247"} Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.832134 5768 generic.go:356] "Generic (PLEG): container finished" podID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerID="7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56" exitCode=0 Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.834461 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.835098 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" event={"ID":"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c","Type":"ContainerDied","Data":"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56"} Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.835142 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4" event={"ID":"d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c","Type":"ContainerDied","Data":"92cb64700f25560d5863545d6e71346ad71d93b589fa656f62322a138b9022a8"} Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.835172 5768 scope.go:122] "RemoveContainer" containerID="7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56" Oct 30 14:26:26.838525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.836245 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:26:26.932692 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.932571 5768 scope.go:122] "RemoveContainer" containerID="7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56" Oct 30 14:26:26.932996 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:26.932967 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56\": container with ID starting with 7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56 not found: ID does not exist" containerID="7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56" Oct 30 14:26:26.933912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.933652 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56"} err="failed to get container status \"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56\": rpc error: code = NotFound desc = could not find container \"7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56\": container with ID starting with 7d52de25fd93ea2d624d364cd692a53c5f4ed9c3bce3abba32b7764e97859e56 not found: ID does not exist" Oct 30 14:26:26.939722 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.939672 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:26:26.967668 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.967639 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:26:26.971218 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:26.971192 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-crnn4"] Oct 30 14:26:27.061341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061311 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061388 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061417 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061482 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061540 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061617 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061717 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061762 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.061927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.061842 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\") pod \"1e74d135-83a5-4376-8219-4cd942ee360d\" (UID: \"1e74d135-83a5-4376-8219-4cd942ee360d\") " Oct 30 14:26:27.062341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.062311 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.063019 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.062521 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.063019 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.062989 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.063459 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.063441 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:27.063656 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.063638 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.065695 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.065675 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.065901 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.065840 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:27.066008 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.065962 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.066728 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.066705 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv" pod "1e74d135-83a5-4376-8219-4cd942ee360d" (UID: "1e74d135-83a5-4376-8219-4cd942ee360d"). InnerVolumeSpecName "kube-api-access-4s2cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.163337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163301 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163332 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163348 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163360 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163371 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163383 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s2cv\" (UniqueName: \"kubernetes.io/projected/1e74d135-83a5-4376-8219-4cd942ee360d-kube-api-access-4s2cv\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163395 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e74d135-83a5-4376-8219-4cd942ee360d-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163406 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e74d135-83a5-4376-8219-4cd942ee360d-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.163584 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.163416 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e74d135-83a5-4376-8219-4cd942ee360d-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.515525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.515499 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:26:27.571135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571103 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:26:27.571135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571126 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571168 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571266 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571297 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571355 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571430 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571462 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571527 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.571629 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571593 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\") pod \"4a7fcf23-2283-40b7-ad88-2b2acd640774\" (UID: \"4a7fcf23-2283-40b7-ad88-2b2acd640774\") " Oct 30 14:26:27.572018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571668 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.572018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571681 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.572018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571814 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.572018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.571975 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:27.572267 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.572199 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.572440 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.572267 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a7fcf23-2283-40b7-ad88-2b2acd640774-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.572440 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.572296 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.572577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.572403 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.572577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.572473 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.574281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.574131 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.574281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.574137 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:27.574281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.574246 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "kube-api-access-t6khc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.574502 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.574359 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token" pod "4a7fcf23-2283-40b7-ad88-2b2acd640774" (UID: "4a7fcf23-2283-40b7-ad88-2b2acd640774"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.603200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.603139 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:27.673481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673443 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.673768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673527 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.673768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673630 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.673768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673667 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.673768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673717 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.674034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673774 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.674034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673825 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.674034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673835 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.674034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673906 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.674034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.673957 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\") pod \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\" (UID: \"64cdcd62-a27d-4933-939d-e25ce3e18a4a\") " Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674389 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674414 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674428 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674451 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674466 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a7fcf23-2283-40b7-ad88-2b2acd640774-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674479 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6khc\" (UniqueName: \"kubernetes.io/projected/4a7fcf23-2283-40b7-ad88-2b2acd640774-kube-api-access-t6khc\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.674409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.674938 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.676444 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.675980 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:27.676444 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.676363 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.676444 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.676419 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.677036 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.677011 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "kube-api-access-cqdhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.677913 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.677887 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:27.678707 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.678666 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:27.679168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.679149 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo" pod "64cdcd62-a27d-4933-939d-e25ce3e18a4a" (UID: "64cdcd62-a27d-4933-939d-e25ce3e18a4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:27.768243 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.768084 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:27.775862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775829 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775867 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775881 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775895 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775908 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775919 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775932 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cdcd62-a27d-4933-939d-e25ce3e18a4a-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.775992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.775945 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqdhz\" (UniqueName: \"kubernetes.io/projected/64cdcd62-a27d-4933-939d-e25ce3e18a4a-kube-api-access-cqdhz\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:27.839933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.839904 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" Oct 30 14:26:27.840087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.839932 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv" event={"ID":"1e74d135-83a5-4376-8219-4cd942ee360d","Type":"ContainerDied","Data":"26972a9626424bbfdeb7f65cb9611697cb6e461a0358d40c36b9f24794015290"} Oct 30 14:26:27.840087 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.840006 5768 scope.go:122] "RemoveContainer" containerID="d69337f1bff39d2853fa1c5b1a0d4191c53c0a026e2fed483062a0c21814b247" Oct 30 14:26:27.841380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.841358 5768 generic.go:356] "Generic (PLEG): container finished" podID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerID="36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3" exitCode=0 Oct 30 14:26:27.841483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.841425 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" event={"ID":"4a7fcf23-2283-40b7-ad88-2b2acd640774","Type":"ContainerDied","Data":"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3"} Oct 30 14:26:27.841483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.841457 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" event={"ID":"4a7fcf23-2283-40b7-ad88-2b2acd640774","Type":"ContainerDied","Data":"898d760840434f7e5af2956edd3966afced87a030b271d4f259a92601ab0c71b"} Oct 30 14:26:27.841761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.841512 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq" Oct 30 14:26:27.852577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.852508 5768 generic.go:356] "Generic (PLEG): container finished" podID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerID="47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53" exitCode=0 Oct 30 14:26:27.853971 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.853889 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" Oct 30 14:26:27.854256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.854230 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" event={"ID":"64cdcd62-a27d-4933-939d-e25ce3e18a4a","Type":"ContainerDied","Data":"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53"} Oct 30 14:26:27.854339 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.854327 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v" event={"ID":"64cdcd62-a27d-4933-939d-e25ce3e18a4a","Type":"ContainerDied","Data":"18dd67947e15724950f9c525cdaf01664a5d146e37dc6a00b917673ea6351c7e"} Oct 30 14:26:27.854702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.854681 5768 scope.go:122] "RemoveContainer" containerID="36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3" Oct 30 14:26:27.914989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.913821 5768 scope.go:122] "RemoveContainer" containerID="36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3" Oct 30 14:26:27.915617 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:27.915234 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3\": container with ID starting with 36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3 not found: ID does not exist" containerID="36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3" Oct 30 14:26:27.915617 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.915281 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3"} err="failed to get container status \"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3\": rpc error: code = NotFound desc = could not find container \"36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3\": container with ID starting with 36cc6e74b2e136a4091eb967eae0440c4c20a59c96941cffaa51f1d29ef41ca3 not found: ID does not exist" Oct 30 14:26:27.915617 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.915309 5768 scope.go:122] "RemoveContainer" containerID="47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53" Oct 30 14:26:27.935789 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.934911 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:26:27.935789 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.935181 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" containerID="cri-o://0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b" gracePeriod=30 Oct 30 14:26:27.949653 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.949600 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:26:27.950132 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.950099 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" containerID="cri-o://dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c" gracePeriod=30 Oct 30 14:26:27.953799 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.953779 5768 scope.go:122] "RemoveContainer" containerID="47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53" Oct 30 14:26:27.954132 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:27.954108 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53\": container with ID starting with 47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53 not found: ID does not exist" containerID="47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53" Oct 30 14:26:27.954270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.954143 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53"} err="failed to get container status \"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53\": rpc error: code = NotFound desc = could not find container \"47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53\": container with ID starting with 47cc5ebdd8fa856ea24ac23eaa00100d5973154821463eee94171d4b6bdada53 not found: ID does not exist" Oct 30 14:26:27.954270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.954225 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:26:27.955655 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.954645 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" containerID="cri-o://79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f" gracePeriod=30 Oct 30 14:26:27.961428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.961398 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:26:27.979333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.978151 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-fbx2v"] Oct 30 14:26:27.984357 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.984332 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:26:27.984599 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.984575 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" containerID="cri-o://d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6" gracePeriod=30 Oct 30 14:26:27.985007 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:27.984878 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:28.020264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.020235 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:26:28.031598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.031200 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-q74zq"] Oct 30 14:26:28.113620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.112462 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:26:28.134305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.131488 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-24dfd7-openshift-default-67746fb97c-2wlhv"] Oct 30 14:26:28.149869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.149842 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:26:28.315943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.315910 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316073 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316112 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316144 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316191 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316343 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316457 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316526 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316672 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.316792 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316726 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:28.317118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.316997 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.317118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317045 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\") pod \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\" (UID: \"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d\") " Oct 30 14:26:28.317294 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317261 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:28.318452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317887 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.318452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317924 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.318452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317938 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.318452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317950 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.318452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.317692 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:28.319452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.319428 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:28.319777 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.319751 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:28.320596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.320570 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "kube-api-access-9khm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:28.320761 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.320730 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token" pod "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" (UID: "0fafb4f8-23c4-4ced-802c-8cd561a4ce5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:28.419837 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.419791 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.419837 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.419840 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.420086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.419859 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9khm9\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-kube-api-access-9khm9\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.420086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.419875 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.420086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.419890 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:28.790441 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.790365 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" path="/var/lib/kubelet/pods/1e74d135-83a5-4376-8219-4cd942ee360d/volumes" Oct 30 14:26:28.791946 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.791919 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" path="/var/lib/kubelet/pods/4a7fcf23-2283-40b7-ad88-2b2acd640774/volumes" Oct 30 14:26:28.792759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.792737 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" path="/var/lib/kubelet/pods/64cdcd62-a27d-4933-939d-e25ce3e18a4a/volumes" Oct 30 14:26:28.793988 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.793965 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" path="/var/lib/kubelet/pods/d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c/volumes" Oct 30 14:26:28.868030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.867997 5768 generic.go:356] "Generic (PLEG): container finished" podID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerID="f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07" exitCode=0 Oct 30 14:26:28.868338 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.868296 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" event={"ID":"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d","Type":"ContainerDied","Data":"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07"} Oct 30 14:26:28.868453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.868356 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" event={"ID":"0fafb4f8-23c4-4ced-802c-8cd561a4ce5d","Type":"ContainerDied","Data":"11ad1bcfc758b84af30cb0648729536d6965d1fec371c80b1f31f86665f4529a"} Oct 30 14:26:28.868453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.868388 5768 scope.go:122] "RemoveContainer" containerID="f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07" Oct 30 14:26:28.868787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.868503 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2" Oct 30 14:26:28.890180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.890160 5768 scope.go:122] "RemoveContainer" containerID="f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07" Oct 30 14:26:28.890575 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:28.890531 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07\": container with ID starting with f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07 not found: ID does not exist" containerID="f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07" Oct 30 14:26:28.890673 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.890582 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07"} err="failed to get container status \"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07\": rpc error: code = NotFound desc = could not find container \"f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07\": container with ID starting with f8aacdd7740ed5ea8c35f178bc58ad638eb5412c7d8ef81e4d95e6c28e6f4f07 not found: ID does not exist" Oct 30 14:26:28.928645 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.928608 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:26:28.940729 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:28.940095 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-8rvt2"] Oct 30 14:26:29.563574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:29.560031 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:30.784668 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:30.784635 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" path="/var/lib/kubelet/pods/0fafb4f8-23c4-4ced-802c-8cd561a4ce5d/volumes" Oct 30 14:26:31.243757 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.243721 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:31.430432 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.430366 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:31.472852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.472824 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.472870 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.472974 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.472997 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473016 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473044 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473105 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473154 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473163 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:31.473372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473181 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\") pod \"67599d04-2db7-44a4-afe5-5c921aa11ea1\" (UID: \"67599d04-2db7-44a4-afe5-5c921aa11ea1\") " Oct 30 14:26:31.473372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473335 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:31.473372 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473344 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:31.473626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473535 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:31.473626 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473544 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:31.473829 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473787 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.473829 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473811 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.473829 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473825 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.473991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473862 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.473991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.473878 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67599d04-2db7-44a4-afe5-5c921aa11ea1-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.475471 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.475447 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:31.475596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.475492 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "kube-api-access-pzjhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:31.475762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.475744 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:31.475762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.475751 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo" pod "67599d04-2db7-44a4-afe5-5c921aa11ea1" (UID: "67599d04-2db7-44a4-afe5-5c921aa11ea1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:31.575350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.575312 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.575350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.575349 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.575607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.575365 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzjhr\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-kube-api-access-pzjhr\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.575607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.575381 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67599d04-2db7-44a4-afe5-5c921aa11ea1-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:31.634160 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.634125 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:31.785170 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.785084 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:31.845404 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:31.845363 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:26:31.896201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.896167 5768 generic.go:356] "Generic (PLEG): container finished" podID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerID="e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10" exitCode=0 Oct 30 14:26:31.896367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.896214 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" Oct 30 14:26:31.896367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.896253 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" event={"ID":"67599d04-2db7-44a4-afe5-5c921aa11ea1","Type":"ContainerDied","Data":"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10"} Oct 30 14:26:31.896367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.896307 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp" event={"ID":"67599d04-2db7-44a4-afe5-5c921aa11ea1","Type":"ContainerDied","Data":"000766fe6b9705320cdeaa37f648a04dfddbc44446b27db46743a17b32f61fa1"} Oct 30 14:26:31.896367 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.896335 5768 scope.go:122] "RemoveContainer" containerID="e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10" Oct 30 14:26:31.907060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.907041 5768 scope.go:122] "RemoveContainer" containerID="e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10" Oct 30 14:26:31.907336 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:31.907315 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10\": container with ID starting with e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10 not found: ID does not exist" containerID="e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10" Oct 30 14:26:31.907399 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.907348 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10"} err="failed to get container status \"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10\": rpc error: code = NotFound desc = could not find container \"e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10\": container with ID starting with e9a8373aaa9f9d988bdf7f5f7b466a02ef20467df1efd327ffbdf5294b550a10 not found: ID does not exist" Oct 30 14:26:31.950824 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.950801 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:31.962483 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:31.962460 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1d36cf-openshift-default-75ff6dbd7-lmdnp"] Oct 30 14:26:32.785110 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:32.785076 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" path="/var/lib/kubelet/pods/67599d04-2db7-44a4-afe5-5c921aa11ea1/volumes" Oct 30 14:26:33.261433 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.261388 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:33.291577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.291513 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:26:33.329034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.328970 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:26:33.344028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.343999 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:26:33.400522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400476 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400530 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400602 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400632 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400661 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400687 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.400738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400729 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400758 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400809 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400837 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400868 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400929 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.400960 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401003 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401036 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401068 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401112 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401185 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401226 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401297 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401329 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401372 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401398 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401438 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.401564 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401488 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\") pod \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\" (UID: \"7d3fad2b-37a2-4210-81f5-190a5e65ed25\") " Oct 30 14:26:33.402607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401586 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\") pod \"2d911d30-e3dc-4e7c-abff-a07409470c74\" (UID: \"2d911d30-e3dc-4e7c-abff-a07409470c74\") " Oct 30 14:26:33.402607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.401624 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\") pod \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\" (UID: \"a3ae2007-95a8-43c4-bb76-76b7ebec71d2\") " Oct 30 14:26:33.402607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.402467 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.402991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.402727 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.404023 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.403747 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.404525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.404378 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.404850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.404663 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.405227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.404967 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.405708 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.405687 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:33.406228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.405981 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:33.406228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.406057 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:33.406380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.406296 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:33.406994 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.406968 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.407164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.407143 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.407330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.407312 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.408093 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.408065 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.409744 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.409496 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.409744 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.409505 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "kube-api-access-dw7qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.410104 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.409936 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.410272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.410226 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.410272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.410246 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.410678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.410651 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:33.411140 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.411079 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.411853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.411828 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "kube-api-access-n4jgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.411950 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.411862 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.413710 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.413208 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo" pod "a3ae2007-95a8-43c4-bb76-76b7ebec71d2" (UID: "a3ae2007-95a8-43c4-bb76-76b7ebec71d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:33.413710 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.413534 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48" pod "2d911d30-e3dc-4e7c-abff-a07409470c74" (UID: "2d911d30-e3dc-4e7c-abff-a07409470c74"). InnerVolumeSpecName "kube-api-access-m2x48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.414956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.414930 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.416054 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.416030 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy" pod "7d3fad2b-37a2-4210-81f5-190a5e65ed25" (UID: "7d3fad2b-37a2-4210-81f5-190a5e65ed25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.503293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503262 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503293 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503290 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503304 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw7qh\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-kube-api-access-dw7qh\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503318 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503327 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503335 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503344 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503352 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503360 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503370 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503380 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503392 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503399 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503407 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2x48\" (UniqueName: \"kubernetes.io/projected/2d911d30-e3dc-4e7c-abff-a07409470c74-kube-api-access-m2x48\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503415 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503424 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503433 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d911d30-e3dc-4e7c-abff-a07409470c74-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503441 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503449 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503459 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d911d30-e3dc-4e7c-abff-a07409470c74-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503471 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d911d30-e3dc-4e7c-abff-a07409470c74-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503478 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4jgr\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-kube-api-access-n4jgr\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.503481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503486 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.504069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503495 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3ae2007-95a8-43c4-bb76-76b7ebec71d2-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.504069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503503 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.504069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503510 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.504069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.503518 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3fad2b-37a2-4210-81f5-190a5e65ed25-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.595479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.595457 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:26:33.705819 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.705771 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.705992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.705830 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.705992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.705883 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.705992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.705931 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.705992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.705958 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.706202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706023 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.706202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706092 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.706202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706099 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.706202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706103 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.706202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706178 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.706453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706315 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\") pod \"e090260f-c79e-4781-999a-dfa25ea12d1d\" (UID: \"e090260f-c79e-4781-999a-dfa25ea12d1d\") " Oct 30 14:26:33.706453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706305 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.706453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706378 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.706833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706733 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:26:33.706983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706739 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.706983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706936 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.706983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706953 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.706983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.706968 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.708370 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.708346 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:26:33.708459 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.708374 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.708848 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.708825 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:26:33.708848 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.708841 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9" pod "e090260f-c79e-4781-999a-dfa25ea12d1d" (UID: "e090260f-c79e-4781-999a-dfa25ea12d1d"). InnerVolumeSpecName "kube-api-access-lkdz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:26:33.807968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.807920 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.807968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.807962 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.807968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.807976 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkdz9\" (UniqueName: \"kubernetes.io/projected/e090260f-c79e-4781-999a-dfa25ea12d1d-kube-api-access-lkdz9\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.808179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.807991 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e090260f-c79e-4781-999a-dfa25ea12d1d-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.808179 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.808002 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e090260f-c79e-4781-999a-dfa25ea12d1d-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:26:33.910827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.910739 5768 generic.go:356] "Generic (PLEG): container finished" podID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerID="0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b" exitCode=0 Oct 30 14:26:33.910827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.910803 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" Oct 30 14:26:33.911072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.910818 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" event={"ID":"e090260f-c79e-4781-999a-dfa25ea12d1d","Type":"ContainerDied","Data":"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b"} Oct 30 14:26:33.911072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.910880 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w" event={"ID":"e090260f-c79e-4781-999a-dfa25ea12d1d","Type":"ContainerDied","Data":"ea789dffdde12735684022029cb8b606fbab6787c6b18cdf4c86b8dde7ece415"} Oct 30 14:26:33.911072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.910902 5768 scope.go:122] "RemoveContainer" containerID="0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b" Oct 30 14:26:33.912865 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.912839 5768 generic.go:356] "Generic (PLEG): container finished" podID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerID="d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6" exitCode=0 Oct 30 14:26:33.913167 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.912890 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" Oct 30 14:26:33.913621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.912909 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerDied","Data":"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6"} Oct 30 14:26:33.913621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.913539 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj" event={"ID":"a3ae2007-95a8-43c4-bb76-76b7ebec71d2","Type":"ContainerDied","Data":"ea3d7682c8445d88eda4976d650ac0de34634aa714dfb20c667759cd0639e101"} Oct 30 14:26:33.918862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.918839 5768 generic.go:356] "Generic (PLEG): container finished" podID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerID="79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f" exitCode=0 Oct 30 14:26:33.918968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.918914 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" Oct 30 14:26:33.918968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.918957 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" event={"ID":"7d3fad2b-37a2-4210-81f5-190a5e65ed25","Type":"ContainerDied","Data":"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f"} Oct 30 14:26:33.919091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.918998 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9" event={"ID":"7d3fad2b-37a2-4210-81f5-190a5e65ed25","Type":"ContainerDied","Data":"1df9f877470187056f627b6e8b038ab3c4bc0961f8bc8e3611c429905d69147d"} Oct 30 14:26:33.920721 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.920697 5768 generic.go:356] "Generic (PLEG): container finished" podID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerID="dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c" exitCode=0 Oct 30 14:26:33.920835 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.920742 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" Oct 30 14:26:33.920835 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.920760 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" event={"ID":"2d911d30-e3dc-4e7c-abff-a07409470c74","Type":"ContainerDied","Data":"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c"} Oct 30 14:26:33.920835 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.920817 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm" event={"ID":"2d911d30-e3dc-4e7c-abff-a07409470c74","Type":"ContainerDied","Data":"b48d25e3eacdb4f225ca578dc502a6bdb4bda863f87d0d05a8100394fc9de657"} Oct 30 14:26:33.922938 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.922890 5768 scope.go:122] "RemoveContainer" containerID="0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b" Oct 30 14:26:33.923232 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:33.923210 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b\": container with ID starting with 0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b not found: ID does not exist" containerID="0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b" Oct 30 14:26:33.923373 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.923238 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b"} err="failed to get container status \"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b\": rpc error: code = NotFound desc = could not find container \"0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b\": container with ID starting with 0a1b60be621fe3a29d37164fc6c650df0d3c33c2dd89e3508b0a344ed5abc75b not found: ID does not exist" Oct 30 14:26:33.923373 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.923253 5768 scope.go:122] "RemoveContainer" containerID="d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6" Oct 30 14:26:33.937423 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.937402 5768 scope.go:122] "RemoveContainer" containerID="7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce" Oct 30 14:26:33.979810 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.979792 5768 scope.go:122] "RemoveContainer" containerID="d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6" Oct 30 14:26:33.980136 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:33.980106 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6\": container with ID starting with d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6 not found: ID does not exist" containerID="d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6" Oct 30 14:26:33.980220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.980133 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6"} err="failed to get container status \"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6\": rpc error: code = NotFound desc = could not find container \"d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6\": container with ID starting with d7a40a33881f955b3c3a1de70f4f6a9901c7ea637589e737830dbcf7c88a68e6 not found: ID does not exist" Oct 30 14:26:33.980220 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.980151 5768 scope.go:122] "RemoveContainer" containerID="7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce" Oct 30 14:26:33.980461 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:33.980442 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce\": container with ID starting with 7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce not found: ID does not exist" containerID="7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce" Oct 30 14:26:33.980539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.980466 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce"} err="failed to get container status \"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce\": rpc error: code = NotFound desc = could not find container \"7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce\": container with ID starting with 7c074374b9187023941b41f7ea51075f12bd9a65db48fc52fbe8d15923c990ce not found: ID does not exist" Oct 30 14:26:33.980539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.980484 5768 scope.go:122] "RemoveContainer" containerID="79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f" Oct 30 14:26:33.989929 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.989911 5768 scope.go:122] "RemoveContainer" containerID="79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f" Oct 30 14:26:33.990202 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:33.990182 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f\": container with ID starting with 79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f not found: ID does not exist" containerID="79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f" Oct 30 14:26:33.990282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.990212 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f"} err="failed to get container status \"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f\": rpc error: code = NotFound desc = could not find container \"79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f\": container with ID starting with 79d6ef482b11972266f5a1a1a27fe12e9cc603c53da370ed8d57807af6748b3f not found: ID does not exist" Oct 30 14:26:33.990282 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.990234 5768 scope.go:122] "RemoveContainer" containerID="dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c" Oct 30 14:26:33.997199 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.997172 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:26:33.999527 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.999505 5768 scope.go:122] "RemoveContainer" containerID="dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c" Oct 30 14:26:33.999876 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:26:33.999852 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c\": container with ID starting with dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c not found: ID does not exist" containerID="dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c" Oct 30 14:26:33.999939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:33.999887 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c"} err="failed to get container status \"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c\": rpc error: code = NotFound desc = could not find container \"dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c\": container with ID starting with dfeec69388663dc9498902db2f7751dccbaaad5d8f6ef9652887413ece0b627c not found: ID does not exist" Oct 30 14:26:34.008495 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.008473 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-r2gwj"] Oct 30 14:26:34.044927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.044896 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:26:34.052208 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.052186 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-d8c6w"] Oct 30 14:26:34.087134 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.087101 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:26:34.089601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.089576 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-f5td9"] Oct 30 14:26:34.127418 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.127384 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:26:34.132833 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.132807 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-bf8266-openshift-default-744cb66d9-whlpm"] Oct 30 14:26:34.791609 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.791572 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" path="/var/lib/kubelet/pods/2d911d30-e3dc-4e7c-abff-a07409470c74/volumes" Oct 30 14:26:34.792203 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.792183 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" path="/var/lib/kubelet/pods/7d3fad2b-37a2-4210-81f5-190a5e65ed25/volumes" Oct 30 14:26:34.792702 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.792683 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" path="/var/lib/kubelet/pods/a3ae2007-95a8-43c4-bb76-76b7ebec71d2/volumes" Oct 30 14:26:34.793470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.793454 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" path="/var/lib/kubelet/pods/e090260f-c79e-4781-999a-dfa25ea12d1d/volumes" Oct 30 14:26:34.887586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:34.887487 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:35.515330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:35.515283 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:36.502718 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:36.502675 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:37.148654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:37.148623 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:37.300832 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:37.300797 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:38.252458 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:38.252426 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:39.839947 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:39.839910 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:39.986687 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:39.986635 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:41.524922 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:41.524885 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:42.977133 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:42.977102 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:43.127388 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:43.127355 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:44.756063 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:44.756029 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:45.641774 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:45.641744 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:46.435755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:46.435695 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:47.013244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013214 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:26:47.013755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013731 5768 cpu_manager.go:414] "containerMap: removing container" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" Oct 30 14:26:47.013755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013748 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013785 5768 cpu_manager.go:414] "containerMap: removing container" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013790 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013798 5768 cpu_manager.go:414] "containerMap: removing container" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013805 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013812 5768 cpu_manager.go:414] "containerMap: removing container" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013816 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013822 5768 cpu_manager.go:414] "containerMap: removing container" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013827 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013832 5768 cpu_manager.go:414] "containerMap: removing container" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013836 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013843 5768 cpu_manager.go:414] "containerMap: removing container" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013848 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013855 5768 cpu_manager.go:414] "containerMap: removing container" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013860 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013870 5768 cpu_manager.go:414] "containerMap: removing container" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013874 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013884 5768 cpu_manager.go:414] "containerMap: removing container" podUID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" containerName="maas-api" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013888 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" containerName="maas-api" Oct 30 14:26:47.013886 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013894 5768 cpu_manager.go:414] "containerMap: removing container" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013899 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013905 5768 cpu_manager.go:414] "containerMap: removing container" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013909 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013985 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e74d135-83a5-4376-8219-4cd942ee360d" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013992 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fafb4f8-23c4-4ced-802c-8cd561a4ce5d" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.013998 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0fd3806-e5ea-47fa-a4f9-2e4c74e4af7c" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014004 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d3fad2b-37a2-4210-81f5-190a5e65ed25" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014010 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014015 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3ae2007-95a8-43c4-bb76-76b7ebec71d2" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014020 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a7fcf23-2283-40b7-ad88-2b2acd640774" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014026 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d911d30-e3dc-4e7c-abff-a07409470c74" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014031 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="055c54ab-de2a-4f20-aefa-21a47b5fdbf4" containerName="maas-api" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014037 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="e090260f-c79e-4781-999a-dfa25ea12d1d" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014041 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="64cdcd62-a27d-4933-939d-e25ce3e18a4a" containerName="istio-proxy" Oct 30 14:26:47.014479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.014046 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="67599d04-2db7-44a4-afe5-5c921aa11ea1" containerName="istio-proxy" Oct 30 14:26:47.022743 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.022724 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.046801 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.046773 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:26:47.156229 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156199 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156229 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156231 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156342 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156372 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156394 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglfd\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156480 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156622 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156718 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156662 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.156718 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.156681 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.257909 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.257872 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258114 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.257935 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258114 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.257965 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258114 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258041 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258114 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258063 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258150 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258182 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258213 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglfd\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258251 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258280 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258324 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258308 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258513 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258601 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.258928 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.258908 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.260565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.260531 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.260712 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.260695 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.284868 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.284801 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.285016 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.284944 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglfd\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.338685 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.338655 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:47.660631 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.660611 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:26:47.663178 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:26:47.663154 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992768a4_21ca_4257_a626_2fc64ccbb7e1.slice/crio-0fe1f2fd65695e9a8bbc34a6d3d4f3be60d345993e3b7d271b32b65de3792c98 WatchSource:0}: Error finding container 0fe1f2fd65695e9a8bbc34a6d3d4f3be60d345993e3b7d271b32b65de3792c98: Status 404 returned error can't find the container with id 0fe1f2fd65695e9a8bbc34a6d3d4f3be60d345993e3b7d271b32b65de3792c98 Oct 30 14:26:47.665425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.665392 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:47.665505 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.665465 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:47.665505 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:47.665498 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:26:48.016286 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.016242 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" event={"ID":"992768a4-21ca-4257-a626-2fc64ccbb7e1","Type":"ContainerStarted","Data":"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a"} Oct 30 14:26:48.016749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.016333 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" event={"ID":"992768a4-21ca-4257-a626-2fc64ccbb7e1","Type":"ContainerStarted","Data":"0fe1f2fd65695e9a8bbc34a6d3d4f3be60d345993e3b7d271b32b65de3792c98"} Oct 30 14:26:48.056399 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.056361 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:48.065465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.065398 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podStartSLOduration=2.06537945 podStartE2EDuration="2.06537945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:26:48.060530335 +0000 UTC m=+1159.399329346" watchObservedRunningTime="2026-10-30 14:26:48.06537945 +0000 UTC m=+1159.404178462" Oct 30 14:26:48.339251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.339166 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:48.340270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.340242 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:48.340381 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:48.340293 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:49.338967 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:49.338938 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:49.339364 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:49.338983 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:49.737453 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:49.737421 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:50.339516 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:50.339475 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:50.340103 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:50.339532 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:51.339368 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:51.339337 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:51.339576 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:51.339388 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:51.485596 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:51.485087 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:51.630032 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:51.629944 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:52.339727 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:52.339695 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:52.340134 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:52.339746 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:53.339632 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:53.339598 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body= Oct 30 14:26:53.339827 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:53.339661 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" Oct 30 14:26:53.385542 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:53.385508 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:54.686620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:54.686587 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:54.687535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:54.687502 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:54.689009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:54.688986 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:26:54.976944 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:54.976859 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:55.831233 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:55.831192 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:56.909538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:56.909509 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:26:58.525760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:26:58.525726 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:00.099380 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:00.099345 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:01.845465 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:01.845431 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:27:02.089144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:02.089108 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:03.837030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:03.836993 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:05.459768 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:05.459714 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:06.526614 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:06.526576 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:07.235725 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:07.235685 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:08.911597 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:08.902752 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:10.520356 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:10.520325 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:11.612874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:11.612845 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:12.198337 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:12.198290 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:13.772932 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:13.772900 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:15.540246 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:15.540201 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:17.191718 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:17.191679 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:17.331995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:17.331947 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:19.077009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:19.076974 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:20.649640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:20.649600 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:22.306033 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:22.303882 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:24.046542 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:24.046484 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:24.284306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:24.284266 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:25.853869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:25.853838 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:27.651701 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:27.651666 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:29.021760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.021730 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:27:29.022279 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.021972 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" podUID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" containerName="maas-api" containerID="cri-o://2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d" gracePeriod=30 Oct 30 14:27:29.122729 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.122697 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:29.242963 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.242925 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:27:29.373957 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.373914 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:29.562855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.562775 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:27:29.575935 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.575854 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\") pod \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " Oct 30 14:27:29.576108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.575983 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") pod \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " Oct 30 14:27:29.576108 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.576089 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\") pod \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " Oct 30 14:27:29.576239 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.576121 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca" pod "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" (UID: "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:27:29.576239 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.576183 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\" (UniqueName: \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\") pod \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\" (UID: \"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3\") " Oct 30 14:27:29.576706 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.576664 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:29.578212 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.578182 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls" pod "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" (UID: "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:27:29.578462 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.578439 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs" pod "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" (UID: "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:27:29.578617 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.578598 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw" pod "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" (UID: "dbc81d09-fdad-477d-8d52-ee0d4ff4dab3"). InnerVolumeSpecName "kube-api-access-dzdjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:27:29.647899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.647857 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:29.677326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.677296 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:29.677326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.677322 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:29.677517 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.677333 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzdjw\" (UniqueName: \"kubernetes.io/projected/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3-kube-api-access-dzdjw\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:29.794255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:29.794215 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:30.169060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.169024 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:30.330885 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.330852 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:30.332703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.332673 5768 generic.go:356] "Generic (PLEG): container finished" podID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" containerID="2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d" exitCode=0 Oct 30 14:27:30.332877 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.332852 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" event={"ID":"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3","Type":"ContainerDied","Data":"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d"} Oct 30 14:27:30.332949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.332931 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" Oct 30 14:27:30.332992 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.332941 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c" event={"ID":"dbc81d09-fdad-477d-8d52-ee0d4ff4dab3","Type":"ContainerDied","Data":"508fb84220a3c35e6fc20800ea4eeb709ccc9f9fe48aee0e818337005f5b87bb"} Oct 30 14:27:30.333195 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.333004 5768 scope.go:122] "RemoveContainer" containerID="2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d" Oct 30 14:27:30.345046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.345026 5768 scope.go:122] "RemoveContainer" containerID="2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d" Oct 30 14:27:30.345417 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:30.345395 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d\": container with ID starting with 2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d not found: ID does not exist" containerID="2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d" Oct 30 14:27:30.345519 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.345424 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d"} err="failed to get container status \"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d\": rpc error: code = NotFound desc = could not find container \"2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d\": container with ID starting with 2ff7b6dcc7def26a4d8008a4685996a0565c9122c502ecb41b1cbd6a84dbeb5d not found: ID does not exist" Oct 30 14:27:30.385043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.385012 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:27:30.396155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.396129 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-717995-6f8958c7b7-xck5c"] Oct 30 14:27:30.783790 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:30.783756 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" path="/var/lib/kubelet/pods/dbc81d09-fdad-477d-8d52-ee0d4ff4dab3/volumes" Oct 30 14:27:31.540442 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.540413 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:31.845647 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:31.845570 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:27:31.980095 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.980066 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:27:31.980641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.980622 5768 cpu_manager.go:414] "containerMap: removing container" podUID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" containerName="maas-api" Oct 30 14:27:31.980641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.980641 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" containerName="maas-api" Oct 30 14:27:31.980805 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.980764 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="dbc81d09-fdad-477d-8d52-ee0d4ff4dab3" containerName="maas-api" Oct 30 14:27:31.985775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.985756 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:31.999291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:31.999268 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:27:32.001289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001259 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001403 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001370 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001582 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001520 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001592 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001668 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001638 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001704 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001688 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47dqd\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001713 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001736 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.001856 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.001837 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.003188 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.003172 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.013326 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.013305 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:27:32.033598 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.029703 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:27:32.103422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103329 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103365 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.103697 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103440 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103697 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103466 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.103697 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103632 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103697 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103670 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103700 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47dqd\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103732 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlw5k\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103760 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103776 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103795 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.103902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103889 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103937 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103968 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.103969 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104049 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104111 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.104183 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104167 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.104470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104190 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104243 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104470 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104330 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.104595 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104469 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.104862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.104843 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.105956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.105938 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.106043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.106025 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.129929 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.129898 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.130086 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.129992 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47dqd\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.142852 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.142823 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:27:32.147877 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.147857 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.175303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.175270 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:27:32.204991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.204954 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205005 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5vr\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205033 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205059 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205155 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205078 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205235 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205294 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205331 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205371 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205387 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205439 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205391 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205506 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205540 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205613 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205622 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205676 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlw5k\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205930 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205733 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205930 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205773 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205930 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205807 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.205930 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205837 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.205930 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.205885 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.206410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.206371 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.206737 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.206710 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.207669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.207643 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.208828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.208807 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.230775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.230750 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlw5k\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.231733 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.231714 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\") pod \"e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.300869 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.300837 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:32.307466 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307443 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5vr\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307482 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307500 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307535 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307575 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307639 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307681 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307734 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.307816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307760 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.308010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307953 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.308010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.307967 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.308100 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.308040 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.308369 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.308276 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.308698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.308676 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.309970 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.309952 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.310235 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.310217 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.318132 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.318112 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:32.333259 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.333239 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.333475 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.333451 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5vr\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\") pod \"e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.464945 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.464913 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:32.626306 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.626229 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:27:32.629530 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:27:32.629504 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bc88e4_1332_43bf_a830_4dec58252f51.slice/crio-d8390cffecc49ed910d823803b9873bb76563a6696980cfa310824e420a345d8 WatchSource:0}: Error finding container d8390cffecc49ed910d823803b9873bb76563a6696980cfa310824e420a345d8: Status 404 returned error can't find the container with id d8390cffecc49ed910d823803b9873bb76563a6696980cfa310824e420a345d8 Oct 30 14:27:32.631867 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.631835 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.631927 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.631915 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.631962 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.631945 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.642175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.642145 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:27:32.646967 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:27:32.646942 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9baf7cdf_fef1_4032_8184_ea63307d5202.slice/crio-75f10854c5dc1a3112be10698adb6262edfdb5f41a860d710377c0c1e71a4ea5 WatchSource:0}: Error finding container 75f10854c5dc1a3112be10698adb6262edfdb5f41a860d710377c0c1e71a4ea5: Status 404 returned error can't find the container with id 75f10854c5dc1a3112be10698adb6262edfdb5f41a860d710377c0c1e71a4ea5 Oct 30 14:27:32.649506 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.649468 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.649623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.649580 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.649693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.649632 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.776532 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.774411 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:27:32.786091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.786050 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.786201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.786140 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:32.786201 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:32.786180 5768 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 14:27:33.362619 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.362572 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" event={"ID":"e1bc88e4-1332-43bf-a830-4dec58252f51","Type":"ContainerStarted","Data":"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740"} Oct 30 14:27:33.362825 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.362650 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" event={"ID":"e1bc88e4-1332-43bf-a830-4dec58252f51","Type":"ContainerStarted","Data":"d8390cffecc49ed910d823803b9873bb76563a6696980cfa310824e420a345d8"} Oct 30 14:27:33.364775 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.364749 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" event={"ID":"7b4237a6-ddfd-4265-a9ec-edb45e89d141","Type":"ContainerStarted","Data":"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79"} Oct 30 14:27:33.364881 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.364799 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" event={"ID":"7b4237a6-ddfd-4265-a9ec-edb45e89d141","Type":"ContainerStarted","Data":"40efbba2e6c1043096f14cc6302dca16e0104032e9250302ac66671a88092b4b"} Oct 30 14:27:33.366340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.366316 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" event={"ID":"9baf7cdf-fef1-4032-8184-ea63307d5202","Type":"ContainerStarted","Data":"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64"} Oct 30 14:27:33.366428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.366360 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" event={"ID":"9baf7cdf-fef1-4032-8184-ea63307d5202","Type":"ContainerStarted","Data":"75f10854c5dc1a3112be10698adb6262edfdb5f41a860d710377c0c1e71a4ea5"} Oct 30 14:27:33.430750 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.430705 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podStartSLOduration=2.430691086 podStartE2EDuration="2.430691086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:33.417922056 +0000 UTC m=+1204.756721092" watchObservedRunningTime="2026-10-30 14:27:33.430691086 +0000 UTC m=+1204.769490095" Oct 30 14:27:33.456644 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.456612 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:33.480575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.474274 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:33.480575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.474806 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podStartSLOduration=2.474787948 podStartE2EDuration="2.474787948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:33.473879581 +0000 UTC m=+1204.812678593" watchObservedRunningTime="2026-10-30 14:27:33.474787948 +0000 UTC m=+1204.813586960" Oct 30 14:27:33.489623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.488334 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:33.489623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.488398 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:33.519811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:33.519752 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podStartSLOduration=1.5197378700000002 podStartE2EDuration="1.51973787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:27:33.519213482 +0000 UTC m=+1204.858012492" watchObservedRunningTime="2026-10-30 14:27:33.51973787 +0000 UTC m=+1204.858536880" Oct 30 14:27:34.305574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.305230 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:34.305574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.305365 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:34.305574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.305427 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:34.322682 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.322649 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:34.323018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.322996 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:34.323188 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.323165 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:34.467958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.467921 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:34.468238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:34.468209 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:35.294098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.294035 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:35.325889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.324641 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:35.325889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.324700 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:35.352167 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.352014 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:35.352167 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.352108 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:35.503098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.503059 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:35.534721 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.534682 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:35.534975 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.519361 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:35.924583 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:35.920741 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:36.303635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.302994 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:36.303635 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.303064 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:36.319982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.319946 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:36.320243 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.320212 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:36.466574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.465992 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:36.466574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:36.466058 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:37.304581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.304141 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:37.304581 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.304202 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:37.332573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.320932 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:37.332573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.320993 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:37.473577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.466671 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:37.473577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.466747 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:37.473577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:37.468692 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:38.179829 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.179795 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:38.304577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.303048 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:38.304577 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.303116 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:38.326574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.324536 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:38.326574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.324633 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:38.459958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.459856 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:38.471034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.470993 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:38.471307 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.471282 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:38.626933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.626902 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:38.821627 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.808668 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:27:38.982893 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.904768 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" containerID="cri-o://7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79" gracePeriod=30 Oct 30 14:27:38.982893 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:38.931025 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:39.301398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.301363 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:39.301750 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.301703 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:39.330024 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.329989 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:39.330305 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.330277 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:39.468949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.468913 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:39.469254 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:39.469224 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:40.301858 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.301825 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body= Oct 30 14:27:40.302364 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.301876 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" Oct 30 14:27:40.308535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.308494 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:40.318854 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.318824 5768 patch_prober.go:29] interesting pod/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body= Oct 30 14:27:40.318963 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.318899 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" Oct 30 14:27:40.466115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.466074 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body= Oct 30 14:27:40.466304 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.466151 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" Oct 30 14:27:40.949224 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:40.949105 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:41.094600 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.093520 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:41.307356 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.307277 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:41.308874 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.308852 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:41.312430 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.312406 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:27:41.322931 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.322902 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:41.323365 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.323344 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:41.324091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:41.324077 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:27:42.145753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:42.145709 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:42.532711 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:42.532671 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:27:42.533334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:42.533301 5768 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:27:43.181060 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:43.181025 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:43.182756 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:43.182733 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:43.185107 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:43.185085 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:27:44.265354 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.265315 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" containerID="cri-o://58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b" gracePeriod=45 Oct 30 14:27:44.273534 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.273509 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:27:44.397615 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397589 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397771 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397667 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397771 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397728 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397772 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397806 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397870 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397877 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.397968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397917 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.397968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397960 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.398178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.397995 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\") pod \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\" (UID: \"72954c43-cb8c-4d20-8ad6-fd306b746c9f\") " Oct 30 14:27:44.398178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398083 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.398178 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398162 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:27:44.398528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398502 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.398528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398528 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.398528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398536 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.398528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398560 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.398889 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.398772 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.400195 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.400172 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:27:44.400721 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.400699 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "kube-api-access-p9dhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:27:44.401085 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.401058 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.401157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.401127 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo" pod "72954c43-cb8c-4d20-8ad6-fd306b746c9f" (UID: "72954c43-cb8c-4d20-8ad6-fd306b746c9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:27:44.499982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.499956 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.499982 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.499983 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.500091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.499992 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.500091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.500003 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72954c43-cb8c-4d20-8ad6-fd306b746c9f-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.500091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.500012 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.500091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.500020 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9dhp\" (UniqueName: \"kubernetes.io/projected/72954c43-cb8c-4d20-8ad6-fd306b746c9f-kube-api-access-p9dhp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.509046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.509023 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:27:44.601009 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.600964 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601051 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601080 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601138 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601358 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601201 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601358 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601254 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\" (UniqueName: \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\") pod \"5c839a85-98db-4604-b506-830d9cee6915\" (UID: \"5c839a85-98db-4604-b506-830d9cee6915\") " Oct 30 14:27:44.601454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601414 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.601863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601636 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.601863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601822 5768 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-home\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.601863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.601840 5768 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-model-cache\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.602606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.602575 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.605152 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.605126 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "kube-api-access-z7qpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:27:44.605250 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.605217 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:27:44.605511 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.605486 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs" pod "5c839a85-98db-4604-b506-830d9cee6915" (UID: "5c839a85-98db-4604-b506-830d9cee6915"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:27:44.669666 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.669637 5768 generic.go:356] "Generic (PLEG): container finished" podID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerID="7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79" exitCode=0 Oct 30 14:27:44.669851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.669697 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" Oct 30 14:27:44.669851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.669721 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerDied","Data":"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79"} Oct 30 14:27:44.669851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.669769 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5" event={"ID":"72954c43-cb8c-4d20-8ad6-fd306b746c9f","Type":"ContainerDied","Data":"e4788e8aafba31ef2b8b630cefbccaf8325bfa239a719bdc17cebc9d222de109"} Oct 30 14:27:44.669851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.669792 5768 scope.go:122] "RemoveContainer" containerID="7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79" Oct 30 14:27:44.671217 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.671195 5768 generic.go:356] "Generic (PLEG): container finished" podID="5c839a85-98db-4604-b506-830d9cee6915" containerID="58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b" exitCode=0 Oct 30 14:27:44.671503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.671229 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" Oct 30 14:27:44.671503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.671282 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" event={"ID":"5c839a85-98db-4604-b506-830d9cee6915","Type":"ContainerDied","Data":"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b"} Oct 30 14:27:44.671503 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.671321 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6" event={"ID":"5c839a85-98db-4604-b506-830d9cee6915","Type":"ContainerDied","Data":"eb3ece8c5794b557d0d0a3b5b68c04466e525b725b21d41406e35077d9f18cbf"} Oct 30 14:27:44.680729 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.680715 5768 scope.go:122] "RemoveContainer" containerID="8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3" Oct 30 14:27:44.690059 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.690041 5768 scope.go:122] "RemoveContainer" containerID="7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79" Oct 30 14:27:44.690346 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:44.690327 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79\": container with ID starting with 7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79 not found: ID does not exist" containerID="7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79" Oct 30 14:27:44.690390 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.690355 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79"} err="failed to get container status \"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79\": rpc error: code = NotFound desc = could not find container \"7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79\": container with ID starting with 7838a8fe6292e9bb71b6cde2e4456b42a7b3cc8fd8e7ab1d9ddf9d77de0c4a79 not found: ID does not exist" Oct 30 14:27:44.690390 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.690370 5768 scope.go:122] "RemoveContainer" containerID="8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3" Oct 30 14:27:44.690625 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:44.690608 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3\": container with ID starting with 8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3 not found: ID does not exist" containerID="8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3" Oct 30 14:27:44.690669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.690633 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3"} err="failed to get container status \"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3\": rpc error: code = NotFound desc = could not find container \"8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3\": container with ID starting with 8a37880bb40b3203aff897e0e615f0268d7f7dbf492ac01341aff56f7c3563e3 not found: ID does not exist" Oct 30 14:27:44.690669 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.690648 5768 scope.go:122] "RemoveContainer" containerID="58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b" Oct 30 14:27:44.698943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.698929 5768 scope.go:122] "RemoveContainer" containerID="58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b" Oct 30 14:27:44.699202 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:44.699183 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b\": container with ID starting with 58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b not found: ID does not exist" containerID="58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b" Oct 30 14:27:44.699251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.699209 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b"} err="failed to get container status \"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b\": rpc error: code = NotFound desc = could not find container \"58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b\": container with ID starting with 58a8f763502c3c4ca661b1cb251c10b1b338bd74765d7692486a19a0e366f51b not found: ID does not exist" Oct 30 14:27:44.703221 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.703196 5768 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-tmp-dir\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.703320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.703226 5768 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c839a85-98db-4604-b506-830d9cee6915-dshm\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.703320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.703237 5768 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c839a85-98db-4604-b506-830d9cee6915-tls-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.703320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.703249 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7qpk\" (UniqueName: \"kubernetes.io/projected/5c839a85-98db-4604-b506-830d9cee6915-kube-api-access-z7qpk\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:44.721893 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.721867 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:27:44.726705 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.726682 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-137f01/simulator-w4-137f01-kserve-5d78744f85-zptk6"] Oct 30 14:27:44.762631 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.762606 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:27:44.771759 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.771727 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-717995-openshift-default-5f475f5df5-dwmv5"] Oct 30 14:27:44.783366 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.783341 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c839a85-98db-4604-b506-830d9cee6915" path="/var/lib/kubelet/pods/5c839a85-98db-4604-b506-830d9cee6915/volumes" Oct 30 14:27:44.783836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:44.783822 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" path="/var/lib/kubelet/pods/72954c43-cb8c-4d20-8ad6-fd306b746c9f/volumes" Oct 30 14:27:48.722303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:48.722263 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:49.209521 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:49.209482 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:49.353112 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:49.353070 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:49.849014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:49.848978 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:50.417575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:50.406585 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:56.911974 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:56.911938 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:27:56.912625 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:56.912189 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" podUID="47bb0e79-631f-49b9-80aa-d6131e05a390" containerName="maas-api" containerID="cri-o://0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386" gracePeriod=30 Oct 30 14:27:57.002671 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.002638 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:57.186853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.171017 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:57.240760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.240726 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:27:57.309231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.309145 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\" (UniqueName: \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\") pod \"47bb0e79-631f-49b9-80aa-d6131e05a390\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " Oct 30 14:27:57.309421 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.309317 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\") pod \"47bb0e79-631f-49b9-80aa-d6131e05a390\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " Oct 30 14:27:57.309421 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.309378 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\") pod \"47bb0e79-631f-49b9-80aa-d6131e05a390\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " Oct 30 14:27:57.309567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.309504 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\") pod \"47bb0e79-631f-49b9-80aa-d6131e05a390\" (UID: \"47bb0e79-631f-49b9-80aa-d6131e05a390\") " Oct 30 14:27:57.309845 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.309819 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca" pod "47bb0e79-631f-49b9-80aa-d6131e05a390" (UID: "47bb0e79-631f-49b9-80aa-d6131e05a390"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:27:57.310033 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.310012 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47bb0e79-631f-49b9-80aa-d6131e05a390-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:57.311684 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.311660 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls" pod "47bb0e79-631f-49b9-80aa-d6131e05a390" (UID: "47bb0e79-631f-49b9-80aa-d6131e05a390"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:27:57.311800 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.311782 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs" pod "47bb0e79-631f-49b9-80aa-d6131e05a390" (UID: "47bb0e79-631f-49b9-80aa-d6131e05a390"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:27:57.311993 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.311978 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq" pod "47bb0e79-631f-49b9-80aa-d6131e05a390" (UID: "47bb0e79-631f-49b9-80aa-d6131e05a390"). InnerVolumeSpecName "kube-api-access-zq2wq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:27:57.364703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.363136 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:57.415595 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.415283 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:57.415595 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.415323 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47bb0e79-631f-49b9-80aa-d6131e05a390-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:57.415595 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.415339 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq2wq\" (UniqueName: \"kubernetes.io/projected/47bb0e79-631f-49b9-80aa-d6131e05a390-kube-api-access-zq2wq\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:27:57.426586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.425648 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:27:57.426586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.425897 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" containerID="cri-o://1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a" gracePeriod=30 Oct 30 14:27:57.441750 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.441662 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:27:57.441917 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.441894 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" containerID="cri-o://a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79" gracePeriod=30 Oct 30 14:27:57.455630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.454737 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:27:57.455630 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.454964 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" containerID="cri-o://2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593" gracePeriod=30 Oct 30 14:27:57.513789 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.513754 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:57.669618 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.666027 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:57.793013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.792917 5768 generic.go:356] "Generic (PLEG): container finished" podID="47bb0e79-631f-49b9-80aa-d6131e05a390" containerID="0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386" exitCode=0 Oct 30 14:27:57.793013 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.792978 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" Oct 30 14:27:57.793260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.793009 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" event={"ID":"47bb0e79-631f-49b9-80aa-d6131e05a390","Type":"ContainerDied","Data":"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386"} Oct 30 14:27:57.793260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.793080 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7" event={"ID":"47bb0e79-631f-49b9-80aa-d6131e05a390","Type":"ContainerDied","Data":"df5387818ba9c469476d0dcc336d60ebeeb673a45ef6923c58c9743f78ffda2d"} Oct 30 14:27:57.793260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.793112 5768 scope.go:122] "RemoveContainer" containerID="0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386" Oct 30 14:27:57.804701 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.804680 5768 scope.go:122] "RemoveContainer" containerID="0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386" Oct 30 14:27:57.805172 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:27:57.805147 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386\": container with ID starting with 0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386 not found: ID does not exist" containerID="0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386" Oct 30 14:27:57.805261 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.805185 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386"} err="failed to get container status \"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386\": rpc error: code = NotFound desc = could not find container \"0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386\": container with ID starting with 0546dce184695b28dc0322415f0a6da53e32fdf694772b3dcfb9d745a7c6e386 not found: ID does not exist" Oct 30 14:27:57.849481 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.849449 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:27:57.855730 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:57.855690 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-7bf15f-769ccdf6b-s65z7"] Oct 30 14:27:58.137210 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:58.137099 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:27:58.185575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:58.185218 5768 patch_prober.go:29] interesting pod/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Oct 30 14:27:58.185575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:58.185292 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 14:27:58.832997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:27:58.832877 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="47bb0e79-631f-49b9-80aa-d6131e05a390" path="/var/lib/kubelet/pods/47bb0e79-631f-49b9-80aa-d6131e05a390/volumes" Oct 30 14:28:01.845200 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:01.845163 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:28:02.719925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.719894 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:28:02.746661 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.746584 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:28:02.772808 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.772786 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:28:02.792216 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792185 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792237 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792304 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.792377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792360 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792393 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792439 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792490 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.792586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792520 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.792586 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792576 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.792845 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792608 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.792845 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792614 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:02.792845 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792656 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.792983 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.792944 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.793075 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.793030 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:02.793165 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.793136 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.793295 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.793273 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.793975 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.793532 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.793975 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.793841 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.795431 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.795410 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.796038 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796018 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.796227 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.795696 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.795948 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796055 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796211 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796289 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796329 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.796398 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796386 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\") pod \"992768a4-21ca-4257-a626-2fc64ccbb7e1\" (UID: \"992768a4-21ca-4257-a626-2fc64ccbb7e1\") " Oct 30 14:28:02.797011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796449 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\") pod \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\" (UID: \"7b4237a6-ddfd-4265-a9ec-edb45e89d141\") " Oct 30 14:28:02.797011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796645 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.797011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.796849 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.797174 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797033 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.797341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797316 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797347 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797360 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797373 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/992768a4-21ca-4257-a626-2fc64ccbb7e1-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797384 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797396 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797448 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797460 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797472 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797486 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797499 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797512 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.797884 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.797524 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b4237a6-ddfd-4265-a9ec-edb45e89d141-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.799281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.799255 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.799281 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.799272 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.799542 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.799523 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd" pod "992768a4-21ca-4257-a626-2fc64ccbb7e1" (UID: "992768a4-21ca-4257-a626-2fc64ccbb7e1"). InnerVolumeSpecName "kube-api-access-zglfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.799675 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.799644 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "kube-api-access-rr5vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.800726 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.800705 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo" pod "7b4237a6-ddfd-4265-a9ec-edb45e89d141" (UID: "7b4237a6-ddfd-4265-a9ec-edb45e89d141"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:02.861628 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.861593 5768 generic.go:356] "Generic (PLEG): container finished" podID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerID="a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79" exitCode=0 Oct 30 14:28:02.862109 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.861660 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" Oct 30 14:28:02.862109 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.861656 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" event={"ID":"7b4237a6-ddfd-4265-a9ec-edb45e89d141","Type":"ContainerDied","Data":"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79"} Oct 30 14:28:02.862109 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.861731 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2" event={"ID":"7b4237a6-ddfd-4265-a9ec-edb45e89d141","Type":"ContainerDied","Data":"40efbba2e6c1043096f14cc6302dca16e0104032e9250302ac66671a88092b4b"} Oct 30 14:28:02.862109 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.861765 5768 scope.go:122] "RemoveContainer" containerID="a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79" Oct 30 14:28:02.863312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.863290 5768 generic.go:356] "Generic (PLEG): container finished" podID="a15bce62-b019-4bd9-8168-7d161b31f045" containerID="2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593" exitCode=0 Oct 30 14:28:02.863620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.863344 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" Oct 30 14:28:02.863620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.863375 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" event={"ID":"a15bce62-b019-4bd9-8168-7d161b31f045","Type":"ContainerDied","Data":"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593"} Oct 30 14:28:02.863620 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.863436 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss" event={"ID":"a15bce62-b019-4bd9-8168-7d161b31f045","Type":"ContainerDied","Data":"0b3982826eda9c272d9e2404d59866e9d0662ad756c115a9a61ba96a38c73743"} Oct 30 14:28:02.865028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.865001 5768 generic.go:356] "Generic (PLEG): container finished" podID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerID="1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a" exitCode=0 Oct 30 14:28:02.865135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.865044 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" Oct 30 14:28:02.865135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.865042 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" event={"ID":"992768a4-21ca-4257-a626-2fc64ccbb7e1","Type":"ContainerDied","Data":"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a"} Oct 30 14:28:02.865135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.865088 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h" event={"ID":"992768a4-21ca-4257-a626-2fc64ccbb7e1","Type":"ContainerDied","Data":"0fe1f2fd65695e9a8bbc34a6d3d4f3be60d345993e3b7d271b32b65de3792c98"} Oct 30 14:28:02.875634 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.875576 5768 scope.go:122] "RemoveContainer" containerID="a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79" Oct 30 14:28:02.876478 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:02.875926 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79\": container with ID starting with a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79 not found: ID does not exist" containerID="a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79" Oct 30 14:28:02.876478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.875953 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79"} err="failed to get container status \"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79\": rpc error: code = NotFound desc = could not find container \"a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79\": container with ID starting with a2e4f1d128786f20bdce1fd709590edcd73c507baf96bc02213ea8b1ca75fa79 not found: ID does not exist" Oct 30 14:28:02.876478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.875970 5768 scope.go:122] "RemoveContainer" containerID="2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593" Oct 30 14:28:02.885977 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.885955 5768 scope.go:122] "RemoveContainer" containerID="2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593" Oct 30 14:28:02.886273 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:02.886255 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593\": container with ID starting with 2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593 not found: ID does not exist" containerID="2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593" Oct 30 14:28:02.886355 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.886288 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593"} err="failed to get container status \"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593\": rpc error: code = NotFound desc = could not find container \"2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593\": container with ID starting with 2eef7c04db95d40f6efe575c64ef1cf2035086227d43a2e6410a80322cda4593 not found: ID does not exist" Oct 30 14:28:02.886355 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.886310 5768 scope.go:122] "RemoveContainer" containerID="1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a" Oct 30 14:28:02.895136 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.895113 5768 scope.go:122] "RemoveContainer" containerID="1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a" Oct 30 14:28:02.895397 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:02.895367 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a\": container with ID starting with 1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a not found: ID does not exist" containerID="1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a" Oct 30 14:28:02.895487 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.895393 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a"} err="failed to get container status \"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a\": rpc error: code = NotFound desc = could not find container \"1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a\": container with ID starting with 1ea2926de2fef03a8c7c30c1018de6e8a02ccd69593eb678c1b64d4d5d3bb65a not found: ID does not exist" Oct 30 14:28:02.898902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.898876 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.898930 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.898999 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899034 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899173 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899077 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899173 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899120 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899242 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899144 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.899334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899265 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.899334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899301 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:02.899334 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899327 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.899538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899355 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\") pod \"a15bce62-b019-4bd9-8168-7d161b31f045\" (UID: \"a15bce62-b019-4bd9-8168-7d161b31f045\") " Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899657 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.899732 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900071 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900092 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/992768a4-21ca-4257-a626-2fc64ccbb7e1-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900105 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900120 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900135 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900147 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b4237a6-ddfd-4265-a9ec-edb45e89d141-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900160 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zglfd\" (UniqueName: \"kubernetes.io/projected/992768a4-21ca-4257-a626-2fc64ccbb7e1-kube-api-access-zglfd\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900177 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr5vr\" (UniqueName: \"kubernetes.io/projected/7b4237a6-ddfd-4265-a9ec-edb45e89d141-kube-api-access-rr5vr\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900190 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.900231 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.900204 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a15bce62-b019-4bd9-8168-7d161b31f045-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:02.901589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.901536 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "kube-api-access-w594j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.902002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.901976 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:02.902133 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.902118 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:02.902232 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.902218 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy" pod "a15bce62-b019-4bd9-8168-7d161b31f045" (UID: "a15bce62-b019-4bd9-8168-7d161b31f045"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:02.948082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.948050 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:28:02.954471 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.954447 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-s5c5h"] Oct 30 14:28:02.989392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.989327 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:28:02.993820 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:02.993795 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-7dlf2"] Oct 30 14:28:03.001295 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.001266 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a15bce62-b019-4bd9-8168-7d161b31f045-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:03.001422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.001301 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a15bce62-b019-4bd9-8168-7d161b31f045-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:03.001422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.001315 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w594j\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-kube-api-access-w594j\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:03.001422 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.001331 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a15bce62-b019-4bd9-8168-7d161b31f045-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:03.212525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.212497 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:28:03.217341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:03.217314 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-137f01-openshift-default-59bc5fc5d9-x2kss"] Oct 30 14:28:04.783223 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:04.783188 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" path="/var/lib/kubelet/pods/7b4237a6-ddfd-4265-a9ec-edb45e89d141/volumes" Oct 30 14:28:04.783640 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:04.783624 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" path="/var/lib/kubelet/pods/992768a4-21ca-4257-a626-2fc64ccbb7e1/volumes" Oct 30 14:28:04.784014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:04.784002 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" path="/var/lib/kubelet/pods/a15bce62-b019-4bd9-8168-7d161b31f045/volumes" Oct 30 14:28:05.025921 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.025891 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:05.185522 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.185495 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:05.322592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.319939 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:28:05.322592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.320177 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" containerID="cri-o://4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740" gracePeriod=30 Oct 30 14:28:05.331425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.331399 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:28:05.331847 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.331817 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" containerID="cri-o://715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59" gracePeriod=30 Oct 30 14:28:05.350467 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.350438 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:28:05.350841 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.350813 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" containerID="cri-o://b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64" gracePeriod=30 Oct 30 14:28:05.388919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.388870 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:05.837664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.837635 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:05.986350 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:05.986314 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:08.701457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:08.701423 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:10.010997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.010966 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:28:10.011479 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.011221 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-67c6566688-4nk2h" podUID="97d465bf-6934-42d5-a467-37b505fa3284" containerName="manager" containerID="cri-o://94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d" gracePeriod=30 Oct 30 14:28:10.260741 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.260717 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:28:10.384856 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.384818 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\") pod \"97d465bf-6934-42d5-a467-37b505fa3284\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " Oct 30 14:28:10.384997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.384978 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\" (UniqueName: \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\") pod \"97d465bf-6934-42d5-a467-37b505fa3284\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " Oct 30 14:28:10.385061 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.385034 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\") pod \"97d465bf-6934-42d5-a467-37b505fa3284\" (UID: \"97d465bf-6934-42d5-a467-37b505fa3284\") " Oct 30 14:28:10.387299 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.387264 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd" pod "97d465bf-6934-42d5-a467-37b505fa3284" (UID: "97d465bf-6934-42d5-a467-37b505fa3284"). InnerVolumeSpecName "kube-api-access-rn6nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.387513 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.387487 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs" pod "97d465bf-6934-42d5-a467-37b505fa3284" (UID: "97d465bf-6934-42d5-a467-37b505fa3284"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:28:10.388025 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.388003 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert" pod "97d465bf-6934-42d5-a467-37b505fa3284" (UID: "97d465bf-6934-42d5-a467-37b505fa3284"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:28:10.487079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.486863 5768 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-webhook-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.487079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.486903 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97d465bf-6934-42d5-a467-37b505fa3284-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.487079 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.486920 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn6nd\" (UniqueName: \"kubernetes.io/projected/97d465bf-6934-42d5-a467-37b505fa3284-kube-api-access-rn6nd\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.500963 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.500933 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:28:10.587392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587362 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587432 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587496 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587601 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587590 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587839 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587631 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587839 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587664 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587839 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587718 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.587839 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587802 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.588039 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.587841 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\") pod \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\" (UID: \"8e6f1057-5ebb-4913-90d7-717d1fd9532b\") " Oct 30 14:28:10.588091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588043 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.588091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588051 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:10.588773 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588393 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.588773 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588616 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.588773 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588687 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.588995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588906 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.588995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588926 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.588995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588940 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.588995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588954 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.588995 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.588968 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.590907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.590870 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:10.591461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.591384 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "kube-api-access-qgbg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.593968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.593948 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.594050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.593980 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy" pod "8e6f1057-5ebb-4913-90d7-717d1fd9532b" (UID: "8e6f1057-5ebb-4913-90d7-717d1fd9532b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.595710 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.595694 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:28:10.626272 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.626252 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:28:10.689494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689465 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.689698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689510 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.689698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689592 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.689698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689621 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.689863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689730 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.689863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689768 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.689863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689771 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.689863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689830 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.689863 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689855 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689876 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689903 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689954 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.689996 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690002 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690042 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690069 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690082 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690115 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690110 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690150 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690182 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\") pod \"e1bc88e4-1332-43bf-a830-4dec58252f51\" (UID: \"e1bc88e4-1332-43bf-a830-4dec58252f51\") " Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690190 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690228 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690259 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\") pod \"9baf7cdf-fef1-4032-8184-ea63307d5202\" (UID: \"9baf7cdf-fef1-4032-8184-ea63307d5202\") " Oct 30 14:28:10.690747 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.690377 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:10.691097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691074 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691102 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691118 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691132 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691157 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691146 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1bc88e4-1332-43bf-a830-4dec58252f51-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691160 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691175 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgbg8\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-kube-api-access-qgbg8\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691190 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691204 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e6f1057-5ebb-4913-90d7-717d1fd9532b-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691342 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691218 5768 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-credential-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.691714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691691 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.691890 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.691869 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.692654 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.692626 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.692755 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.692674 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.693042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.692998 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:10.694410 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.694376 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "kube-api-access-47dqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.695193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.695167 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy" pod "e1bc88e4-1332-43bf-a830-4dec58252f51" (UID: "e1bc88e4-1332-43bf-a830-4dec58252f51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.695336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.695188 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 14:28:10.695336 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.695266 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "kube-api-access-dlw5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.695523 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.695503 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:28:10.695633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.695529 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:28:10.698765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.698745 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy" pod "9baf7cdf-fef1-4032-8184-ea63307d5202" (UID: "9baf7cdf-fef1-4032-8184-ea63307d5202"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.791970 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792024 5768 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-data\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792042 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792054 5768 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-envoy\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792087 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792101 5768 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-socket\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792114 5768 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1bc88e4-1332-43bf-a830-4dec58252f51-workload-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792129 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9baf7cdf-fef1-4032-8184-ea63307d5202-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792141 5768 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9baf7cdf-fef1-4032-8184-ea63307d5202-istiod-ca-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792155 5768 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1bc88e4-1332-43bf-a830-4dec58252f51-istio-podinfo\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792169 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47dqd\" (UniqueName: \"kubernetes.io/projected/e1bc88e4-1332-43bf-a830-4dec58252f51-kube-api-access-47dqd\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.792419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.792183 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlw5k\" (UniqueName: \"kubernetes.io/projected/9baf7cdf-fef1-4032-8184-ea63307d5202-kube-api-access-dlw5k\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:28:10.919107 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.919070 5768 generic.go:356] "Generic (PLEG): container finished" podID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerID="715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59" exitCode=0 Oct 30 14:28:10.919312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.919128 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" Oct 30 14:28:10.919312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.919151 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerDied","Data":"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59"} Oct 30 14:28:10.919312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.919217 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5" event={"ID":"8e6f1057-5ebb-4913-90d7-717d1fd9532b","Type":"ContainerDied","Data":"e3e9f37e0d2981a5c029666598ac19d4ab4ebba62bce88b22adf81a557d044e8"} Oct 30 14:28:10.919312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.919247 5768 scope.go:122] "RemoveContainer" containerID="715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59" Oct 30 14:28:10.920621 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.920597 5768 generic.go:356] "Generic (PLEG): container finished" podID="97d465bf-6934-42d5-a467-37b505fa3284" containerID="94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d" exitCode=0 Oct 30 14:28:10.920714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.920669 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67c6566688-4nk2h" Oct 30 14:28:10.920714 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.920681 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c6566688-4nk2h" event={"ID":"97d465bf-6934-42d5-a467-37b505fa3284","Type":"ContainerDied","Data":"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d"} Oct 30 14:28:10.920811 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.920721 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67c6566688-4nk2h" event={"ID":"97d465bf-6934-42d5-a467-37b505fa3284","Type":"ContainerDied","Data":"c57bac2f28f405d35cb70b87b43f1db5b8109de0e94a2266b699c6171a864de9"} Oct 30 14:28:10.922446 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.922424 5768 generic.go:356] "Generic (PLEG): container finished" podID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerID="b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64" exitCode=0 Oct 30 14:28:10.922543 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.922461 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" event={"ID":"9baf7cdf-fef1-4032-8184-ea63307d5202","Type":"ContainerDied","Data":"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64"} Oct 30 14:28:10.922543 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.922524 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" event={"ID":"9baf7cdf-fef1-4032-8184-ea63307d5202","Type":"ContainerDied","Data":"75f10854c5dc1a3112be10698adb6262edfdb5f41a860d710377c0c1e71a4ea5"} Oct 30 14:28:10.922678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.922471 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z" Oct 30 14:28:10.924021 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.923998 5768 generic.go:356] "Generic (PLEG): container finished" podID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerID="4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740" exitCode=0 Oct 30 14:28:10.924130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.924030 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" Oct 30 14:28:10.924130 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.924033 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" event={"ID":"e1bc88e4-1332-43bf-a830-4dec58252f51","Type":"ContainerDied","Data":"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740"} Oct 30 14:28:10.924228 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.924173 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws" event={"ID":"e1bc88e4-1332-43bf-a830-4dec58252f51","Type":"ContainerDied","Data":"d8390cffecc49ed910d823803b9873bb76563a6696980cfa310824e420a345d8"} Oct 30 14:28:10.930606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.930585 5768 scope.go:122] "RemoveContainer" containerID="10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31" Oct 30 14:28:10.940624 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.940606 5768 scope.go:122] "RemoveContainer" containerID="715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59" Oct 30 14:28:10.940921 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:10.940900 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59\": container with ID starting with 715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59 not found: ID does not exist" containerID="715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59" Oct 30 14:28:10.941003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.940931 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59"} err="failed to get container status \"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59\": rpc error: code = NotFound desc = could not find container \"715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59\": container with ID starting with 715da2025a571e6164d76af41659d6fda4d4baaf16979e620c303513380d8f59 not found: ID does not exist" Oct 30 14:28:10.941003 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.940955 5768 scope.go:122] "RemoveContainer" containerID="10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31" Oct 30 14:28:10.941228 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:10.941209 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31\": container with ID starting with 10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31 not found: ID does not exist" containerID="10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31" Oct 30 14:28:10.941271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.941233 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31"} err="failed to get container status \"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31\": rpc error: code = NotFound desc = could not find container \"10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31\": container with ID starting with 10fe30704705a9aa388dc9aa7c5b82b5f7e073a46f2dfed93d5baf2e7c997b31 not found: ID does not exist" Oct 30 14:28:10.941271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.941246 5768 scope.go:122] "RemoveContainer" containerID="94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d" Oct 30 14:28:10.950050 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.950030 5768 scope.go:122] "RemoveContainer" containerID="94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d" Oct 30 14:28:10.950301 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:10.950284 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d\": container with ID starting with 94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d not found: ID does not exist" containerID="94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d" Oct 30 14:28:10.950341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.950308 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d"} err="failed to get container status \"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d\": rpc error: code = NotFound desc = could not find container \"94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d\": container with ID starting with 94b60a18f9fba79d09e3783999c8f22b3d491f268a9b7c3c05d9f583d21e8f2d not found: ID does not exist" Oct 30 14:28:10.950341 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.950322 5768 scope.go:122] "RemoveContainer" containerID="b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64" Oct 30 14:28:10.958194 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.958180 5768 scope.go:122] "RemoveContainer" containerID="b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64" Oct 30 14:28:10.958453 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:10.958433 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64\": container with ID starting with b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64 not found: ID does not exist" containerID="b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64" Oct 30 14:28:10.958499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.958459 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64"} err="failed to get container status \"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64\": rpc error: code = NotFound desc = could not find container \"b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64\": container with ID starting with b25b9f28b377abbbbf391f6214d9e24ad4509a5ad48d15059a39fe6821766b64 not found: ID does not exist" Oct 30 14:28:10.958499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.958474 5768 scope.go:122] "RemoveContainer" containerID="4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740" Oct 30 14:28:10.966377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.966362 5768 scope.go:122] "RemoveContainer" containerID="4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740" Oct 30 14:28:10.966805 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:10.966784 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740\": container with ID starting with 4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740 not found: ID does not exist" containerID="4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740" Oct 30 14:28:10.966895 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.966812 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740"} err="failed to get container status \"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740\": rpc error: code = NotFound desc = could not find container \"4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740\": container with ID starting with 4aac3229fd9fc0f5d6ec2514b7254a3a422c244b90c4ffa1b1b51254e5f7e740 not found: ID does not exist" Oct 30 14:28:10.974292 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.974270 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:28:10.984211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:10.984191 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4nd2z"] Oct 30 14:28:11.012205 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.012175 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:28:11.019236 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.019165 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-f55ws"] Oct 30 14:28:11.052735 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.052709 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:28:11.056774 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.056749 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67c6566688-4nk2h"] Oct 30 14:28:11.090879 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.090852 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:28:11.095166 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.095136 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-7bf15f-openshift-default-7b7965884f-4khz5"] Oct 30 14:28:11.533196 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.533164 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:11.681953 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:11.681909 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:12.832928 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:12.832895 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" path="/var/lib/kubelet/pods/8e6f1057-5ebb-4913-90d7-717d1fd9532b/volumes" Oct 30 14:28:12.834043 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:12.834020 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="97d465bf-6934-42d5-a467-37b505fa3284" path="/var/lib/kubelet/pods/97d465bf-6934-42d5-a467-37b505fa3284/volumes" Oct 30 14:28:12.834753 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:12.834734 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" path="/var/lib/kubelet/pods/9baf7cdf-fef1-4032-8184-ea63307d5202/volumes" Oct 30 14:28:12.841022 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:12.841000 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" path="/var/lib/kubelet/pods/e1bc88e4-1332-43bf-a830-4dec58252f51/volumes" Oct 30 14:28:13.720119 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:13.720088 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:15.238127 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:15.238086 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:19.779325 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:19.779290 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:31.848245 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:28:31.848206 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:28:37.582935 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:37.582899 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:46.920004 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:46.919907 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:28:48.791961 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:28:48.791918 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:29:01.843991 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:29:01.843953 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:29:11.527991 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:29:11.527946 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:29:31.845361 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:29:31.845325 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:29:37.704216 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:29:37.704177 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:30:01.845010 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:30:01.844977 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:30:01.847936 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:30:01.847905 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:30:31.844370 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:30:31.844326 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:30:37.950575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:30:37.946859 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:31:01.845213 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:31:01.845179 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:31:25.487270 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:31:25.487237 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:31:26.230517 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:31:26.230472 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:31:26.377943 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:31:26.377908 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:31:31.843909 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:31:31.843865 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:31:37.021011 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:31:37.020977 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:31:38.033174 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:31:38.033133 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:32:01.844951 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:32:01.844914 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:32:03.113200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.113163 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:32:03.113724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.113401 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" podUID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" containerName="discovery" containerID="cri-o://df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d" gracePeriod=30 Oct 30 14:32:03.365482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.365420 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:32:03.445606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445570 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.445606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445609 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.445851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445645 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.445851 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445788 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.445977 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445925 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.446049 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.445974 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.446103 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.446083 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\") pod \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\" (UID: \"b4a627b5-847d-4bf4-a1e4-91c318ed08a9\") " Oct 30 14:32:03.446325 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.446296 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:32:03.448144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.448102 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:32:03.448457 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.448430 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:32:03.448531 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.448471 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:32:03.448949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.448916 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "kube-api-access-j2w6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:32:03.449059 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.448970 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:32:03.449059 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.449007 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs" pod "b4a627b5-847d-4bf4-a1e4-91c318ed08a9" (UID: "b4a627b5-847d-4bf4-a1e4-91c318ed08a9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:32:03.503918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.503886 5768 generic.go:356] "Generic (PLEG): container finished" podID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" containerID="df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d" exitCode=0 Oct 30 14:32:03.504051 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.503941 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" Oct 30 14:32:03.504051 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.503969 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" event={"ID":"b4a627b5-847d-4bf4-a1e4-91c318ed08a9","Type":"ContainerDied","Data":"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d"} Oct 30 14:32:03.504051 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.504044 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc" event={"ID":"b4a627b5-847d-4bf4-a1e4-91c318ed08a9","Type":"ContainerDied","Data":"72ede65dcbf7faf63b126de28a3530b81af7c649dd4c80d413792e22631d1742"} Oct 30 14:32:03.504153 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.504066 5768 scope.go:122] "RemoveContainer" containerID="df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d" Oct 30 14:32:03.513882 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.513860 5768 scope.go:122] "RemoveContainer" containerID="df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d" Oct 30 14:32:03.514148 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:32:03.514132 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d\": container with ID starting with df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d not found: ID does not exist" containerID="df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d" Oct 30 14:32:03.514204 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.514155 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d"} err="failed to get container status \"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d\": rpc error: code = NotFound desc = could not find container \"df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d\": container with ID starting with df1a47dcfcdf72440f33c009fae2d23b9f3d39dbc09c34a7936028a341355b4d not found: ID does not exist" Oct 30 14:32:03.547082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547056 5768 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-kubeconfig\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547082 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547080 5768 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-ca-configmap\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547095 5768 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-local-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547108 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2w6f\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-kube-api-access-j2w6f\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547119 5768 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-cacerts\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547131 5768 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-csr-dns-cert\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.547260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.547143 5768 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a627b5-847d-4bf4-a1e4-91c318ed08a9-istio-token\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:32:03.555888 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.555863 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:32:03.558002 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:03.557981 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4kzxc"] Oct 30 14:32:04.783428 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:04.783393 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" path="/var/lib/kubelet/pods/b4a627b5-847d-4bf4-a1e4-91c318ed08a9/volumes" Oct 30 14:32:31.844374 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:32:31.844333 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:32:38.190918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:38.190876 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:32:49.767412 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:32:49.767379 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:01.845645 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:33:01.845607 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:33:06.245940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:06.245902 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:16.703591 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:16.703522 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:17.172772 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:17.172739 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:17.327048 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:17.327011 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:20.917284 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:20.917252 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:21.071494 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:21.071469 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:22.291815 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.291761 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:33:22.292382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292366 5768 cpu_manager.go:414] "containerMap: removing container" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" Oct 30 14:33:22.292382 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292384 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292415 5768 cpu_manager.go:414] "containerMap: removing container" podUID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" containerName="discovery" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292424 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" containerName="discovery" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292437 5768 cpu_manager.go:414] "containerMap: removing container" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292445 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292457 5768 cpu_manager.go:414] "containerMap: removing container" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292464 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292476 5768 cpu_manager.go:414] "containerMap: removing container" podUID="97d465bf-6934-42d5-a467-37b505fa3284" containerName="manager" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292480 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="97d465bf-6934-42d5-a467-37b505fa3284" containerName="manager" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292488 5768 cpu_manager.go:414] "containerMap: removing container" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292492 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:33:22.292497 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292501 5768 cpu_manager.go:414] "containerMap: removing container" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292505 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292510 5768 cpu_manager.go:414] "containerMap: removing container" podUID="47bb0e79-631f-49b9-80aa-d6131e05a390" containerName="maas-api" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292516 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="47bb0e79-631f-49b9-80aa-d6131e05a390" containerName="maas-api" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292522 5768 cpu_manager.go:414] "containerMap: removing container" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292526 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292532 5768 cpu_manager.go:414] "containerMap: removing container" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292536 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292573 5768 cpu_manager.go:414] "containerMap: removing container" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292578 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292669 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292681 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292688 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="992768a4-21ca-4257-a626-2fc64ccbb7e1" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292697 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c839a85-98db-4604-b506-830d9cee6915" containerName="main" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292707 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4a627b5-847d-4bf4-a1e4-91c318ed08a9" containerName="discovery" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292716 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b4237a6-ddfd-4265-a9ec-edb45e89d141" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292724 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="e1bc88e4-1332-43bf-a830-4dec58252f51" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292734 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="97d465bf-6934-42d5-a467-37b505fa3284" containerName="manager" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292743 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="47bb0e79-631f-49b9-80aa-d6131e05a390" containerName="maas-api" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292752 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="9baf7cdf-fef1-4032-8184-ea63307d5202" containerName="istio-proxy" Oct 30 14:33:22.293014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.292758 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="a15bce62-b019-4bd9-8168-7d161b31f045" containerName="istio-proxy" Oct 30 14:33:22.296216 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.296198 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.317866 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.317842 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-2c6211-serving-cert\"" Oct 30 14:33:22.329229 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.329204 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:33:22.351150 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.351119 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.351288 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.351252 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.351329 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.351307 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.351391 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.351375 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d7gc\" (UniqueName: \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.424607 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.424574 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:22.452836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.452809 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.452949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.452875 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.452949 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.452931 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.453045 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.452991 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d7gc\" (UniqueName: \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.453045 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:33:22.453025 5768 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-serving-cert: secret "maas-api-e2e-worker-single-main-2c6211-serving-cert" not found Oct 30 14:33:22.453150 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:33:22.453088 5768 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls podName:7827ceaf-b465-48d0-9ff9-e42bdc71d7c5 nodeName:}" failed. No retries permitted until 2026-10-30 14:33:22.953073088 +0000 UTC m=+1554.291872075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls") pod "maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" (UID: "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5") : secret "maas-api-e2e-worker-single-main-2c6211-serving-cert" not found Oct 30 14:33:22.453633 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.453612 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.455400 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.455378 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.478362 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.478324 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d7gc\" (UniqueName: \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.574651 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.574568 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:22.736529 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.736488 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:22.904513 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.904418 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:22.959894 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.959862 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:22.962377 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:22.962349 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:23.219017 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:23.218985 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:23.527333 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:23.527242 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:33:23.531527 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:33:23.531494 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7827ceaf_b465_48d0_9ff9_e42bdc71d7c5.slice/crio-d5ba4ccfa9ed4e0ec96f19b1e368227bf7067dbad5e9da6089626de3d6c7e5fd WatchSource:0}: Error finding container d5ba4ccfa9ed4e0ec96f19b1e368227bf7067dbad5e9da6089626de3d6c7e5fd: Status 404 returned error can't find the container with id d5ba4ccfa9ed4e0ec96f19b1e368227bf7067dbad5e9da6089626de3d6c7e5fd Oct 30 14:33:23.532965 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:23.532945 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:33:23.958855 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:23.958821 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" event={"ID":"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5","Type":"ContainerStarted","Data":"d5ba4ccfa9ed4e0ec96f19b1e368227bf7067dbad5e9da6089626de3d6c7e5fd"} Oct 30 14:33:24.316528 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:24.316429 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:24.965825 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:24.965787 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" event={"ID":"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5","Type":"ContainerStarted","Data":"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4"} Oct 30 14:33:24.966320 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:24.965868 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:25.010426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:25.010378 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" podStartSLOduration=2.5654270390000002 podStartE2EDuration="3.010364979s" totalImagesPullingTime="444.93794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:33:25.009237511 +0000 UTC m=+1556.348036523" watchObservedRunningTime="2026-10-30 14:33:25.010364979 +0000 UTC m=+1556.349163988" Oct 30 14:33:26.074578 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:26.074528 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:27.851399 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:27.851369 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:29.632828 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:29.632779 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:30.978005 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:30.977979 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:33:31.456679 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:31.456652 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:31.844229 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:33:31.844148 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:33:33.325920 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:33.325890 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:35.070251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:35.070214 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:35.828846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:35.828816 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:36.437411 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:36.437373 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:36.588175 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:36.588145 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:36.894961 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:36.894871 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:37.830112 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:37.830082 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:38.370749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:38.370703 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:38.791848 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:38.791817 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:40.557571 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:40.554947 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:42.461575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:42.461109 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:44.238677 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:44.238607 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:46.001958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:46.001927 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:47.666675 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:47.666630 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:49.505762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:49.505713 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:51.300064 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:51.300029 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:52.976898 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:52.976866 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:55.192191 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:55.192153 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:56.889469 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:56.889432 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:33:58.877727 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:33:58.877693 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:00.571116 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:00.571079 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:01.845536 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:34:01.845502 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:34:02.396758 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:02.396729 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:04.238985 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:04.238947 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:06.009890 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:06.009856 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:07.690944 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:07.690902 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:09.573840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:09.573793 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:11.257830 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:11.257790 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:12.655912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:12.655876 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:13.002016 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:13.001982 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:14.898664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:14.898625 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:16.493658 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:16.493629 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:17.687233 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:17.687193 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:18.137132 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:18.137043 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:19.836092 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:19.836036 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:22.071518 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:22.071478 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:23.421570 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.421527 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:23.453780 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.453743 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:34:23.454041 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.454010 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" podUID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" containerName="maas-api" containerID="cri-o://2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4" gracePeriod=30 Oct 30 14:34:23.759933 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.759902 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:23.898425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.898385 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:34:23.966287 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.966256 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\") pod \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " Oct 30 14:34:23.966482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.966387 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\" (UniqueName: \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\") pod \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " Oct 30 14:34:23.966482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.966426 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\") pod \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " Oct 30 14:34:23.966482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.966457 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") pod \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\" (UID: \"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5\") " Oct 30 14:34:23.966958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.966916 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca" pod "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" (UID: "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:34:23.968990 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.968949 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs" pod "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" (UID: "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:34:23.968990 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.968970 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls" pod "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" (UID: "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:34:23.969174 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:23.969029 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc" pod "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" (UID: "7827ceaf-b465-48d0-9ff9-e42bdc71d7c5"). InnerVolumeSpecName "kube-api-access-5d7gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:34:24.067424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.067342 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:34:24.067424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.067369 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:34:24.067424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.067378 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:34:24.067424 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.067386 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d7gc\" (UniqueName: \"kubernetes.io/projected/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5-kube-api-access-5d7gc\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:34:24.282409 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.282381 5768 generic.go:356] "Generic (PLEG): container finished" podID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" containerID="2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4" exitCode=0 Oct 30 14:34:24.282587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.282428 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" Oct 30 14:34:24.282587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.282459 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" event={"ID":"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5","Type":"ContainerDied","Data":"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4"} Oct 30 14:34:24.282587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.282496 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq" event={"ID":"7827ceaf-b465-48d0-9ff9-e42bdc71d7c5","Type":"ContainerDied","Data":"d5ba4ccfa9ed4e0ec96f19b1e368227bf7067dbad5e9da6089626de3d6c7e5fd"} Oct 30 14:34:24.282587 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.282520 5768 scope.go:122] "RemoveContainer" containerID="2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4" Oct 30 14:34:24.293102 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.293086 5768 scope.go:122] "RemoveContainer" containerID="2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4" Oct 30 14:34:24.293394 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:34:24.293375 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4\": container with ID starting with 2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4 not found: ID does not exist" containerID="2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4" Oct 30 14:34:24.293445 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.293403 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4"} err="failed to get container status \"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4\": rpc error: code = NotFound desc = could not find container \"2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4\": container with ID starting with 2b9ce1f32cacd18ad2e1bd2c670a0e27816c26d8ac53d07c14f011d37173b3e4 not found: ID does not exist" Oct 30 14:34:24.333456 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.333389 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:34:24.344464 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.344432 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-2c6211-d55bc6896-ck2bq"] Oct 30 14:34:24.782512 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.782479 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" path="/var/lib/kubelet/pods/7827ceaf-b465-48d0-9ff9-e42bdc71d7c5/volumes" Oct 30 14:34:24.809602 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.809569 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:24.957868 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:24.957839 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:25.416724 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:25.416693 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:31.828716 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:31.828680 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:31.845209 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:34:31.845180 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:34:31.974330 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:31.974294 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:32.182077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:32.182039 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:38.452452 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:38.452357 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:54.247681 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:54.247648 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:34:55.839902 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:34:55.839858 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:35:01.809569 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:35:01.809509 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:35:01.845337 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:35:01.845302 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:35:31.843947 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:35:31.843908 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:35:38.590939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:35:38.590903 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:01.844573 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:36:01.844519 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:36:31.844407 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:36:31.844372 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:36:38.705042 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:38.705009 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:48.315703 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:48.315668 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:48.781413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:48.781382 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:48.939437 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:48.939385 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:52.322723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:52.322684 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:52.485000 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:52.484970 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:53.808563 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.808524 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:36:53.809092 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809069 5768 cpu_manager.go:414] "containerMap: removing container" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:36:53.809092 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809090 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809104 5768 cpu_manager.go:414] "containerMap: removing container" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809109 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809115 5768 cpu_manager.go:414] "containerMap: removing container" podUID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" containerName="maas-api" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809120 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" containerName="maas-api" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809190 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e6f1057-5ebb-4913-90d7-717d1fd9532b" containerName="istio-proxy" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809202 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="72954c43-cb8c-4d20-8ad6-fd306b746c9f" containerName="istio-proxy" Oct 30 14:36:53.809482 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.809216 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="7827ceaf-b465-48d0-9ff9-e42bdc71d7c5" containerName="maas-api" Oct 30 14:36:53.812543 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.812527 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:53.836846 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.836819 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-e8c73c-serving-cert\"" Oct 30 14:36:53.843693 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.843665 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:36:53.908821 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.908787 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfh4v\" (UniqueName: \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:53.909030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.908836 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:53.909030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.908996 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:53.909147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.909082 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:53.933472 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:53.933440 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:54.009969 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.009939 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfh4v\" (UniqueName: \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.009969 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.009979 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.010234 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.010017 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.010234 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.010056 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.010234 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:36:54.010156 5768 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-serving-cert: secret "maas-api-e2e-worker-single-main-e8c73c-serving-cert" not found Oct 30 14:36:54.010234 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:36:54.010224 5768 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls podName:59bc3256-1f65-463f-824c-6a66d0c7f982 nodeName:}" failed. No retries permitted until 2026-10-30 14:36:54.510206876 +0000 UTC m=+1765.849005864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls") pod "maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" (UID: "59bc3256-1f65-463f-824c-6a66d0c7f982") : secret "maas-api-e2e-worker-single-main-e8c73c-serving-cert" not found Oct 30 14:36:54.010818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.010792 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.012672 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.012649 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.034956 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.034931 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfh4v\" (UniqueName: \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.077918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.077857 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:54.219791 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.219758 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:54.515254 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.515223 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.517767 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.517743 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:54.725636 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:54.725584 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:55.030226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:55.030137 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:36:55.034573 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:36:55.034528 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bc3256_1f65_463f_824c_6a66d0c7f982.slice/crio-8a5214c5e8cad6e823ff2aa038be57581fa9e15a196c166dc150931442918568 WatchSource:0}: Error finding container 8a5214c5e8cad6e823ff2aa038be57581fa9e15a196c166dc150931442918568: Status 404 returned error can't find the container with id 8a5214c5e8cad6e823ff2aa038be57581fa9e15a196c166dc150931442918568 Oct 30 14:36:55.215861 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:55.215829 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" event={"ID":"59bc3256-1f65-463f-824c-6a66d0c7f982","Type":"ContainerStarted","Data":"8a5214c5e8cad6e823ff2aa038be57581fa9e15a196c166dc150931442918568"} Oct 30 14:36:55.767438 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:55.767398 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:56.222499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:56.222462 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" event={"ID":"59bc3256-1f65-463f-824c-6a66d0c7f982","Type":"ContainerStarted","Data":"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124"} Oct 30 14:36:56.222968 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:56.222576 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:36:56.266275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:56.266227 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" podStartSLOduration=2.89371412 podStartE2EDuration="3.266211158s" totalImagesPullingTime="372.497038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:36:56.264174367 +0000 UTC m=+1767.602973378" watchObservedRunningTime="2026-10-30 14:36:56.266211158 +0000 UTC m=+1767.605010169" Oct 30 14:36:57.330401 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:57.330366 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:36:59.069571 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:36:59.063576 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:00.786696 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:00.786662 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:01.844733 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:37:01.844695 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:37:02.232696 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:02.232670 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:37:02.573951 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:02.573877 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:04.336525 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:04.336492 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:06.115240 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:06.115206 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:07.241843 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:07.241799 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:07.818292 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:07.818260 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:07.964006 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:07.963974 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:08.108510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:08.108425 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:09.593592 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:09.593565 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:09.753605 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:09.753574 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:09.891488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:09.891404 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:11.570193 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:11.570150 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:13.542255 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:13.542222 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:15.209997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:15.209957 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:16.858678 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:16.858644 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:18.708375 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:18.708324 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:20.244416 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:20.244373 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:21.975762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:21.975728 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:23.686826 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:23.686791 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:25.382072 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:25.382031 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:27.201567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:27.201518 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:28.913754 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:28.913718 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:30.810709 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:30.810677 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:31.845042 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:37:31.845006 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:37:32.498646 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:32.498601 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:34.243021 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:34.242979 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:36.050023 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:36.049991 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:37.742488 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:37.742422 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:37.899770 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:37.899728 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:38.863887 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:38.863800 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:39.580156 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:39.580122 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:41.326499 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:41.326465 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:42.939948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:42.939919 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:43.088925 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:43.088845 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:44.681787 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:44.681752 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:46.547948 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:46.547906 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:46.696083 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:46.696049 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:47.955698 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:47.955664 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:48.301906 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:48.301814 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:48.706912 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:48.706882 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:48.859118 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:48.859087 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:49.686675 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:49.686608 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:37:49.687211 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:49.686940 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" podUID="59bc3256-1f65-463f-824c-6a66d0c7f982" containerName="maas-api" containerID="cri-o://5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124" gracePeriod=30 Oct 30 14:37:49.789144 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:49.789111 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:50.306900 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:50.306862 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:50.494765 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:50.494736 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:50.937989 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:50.937967 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:37:51.060939 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.060859 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:51.086465 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086434 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\") pod \"59bc3256-1f65-463f-824c-6a66d0c7f982\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " Oct 30 14:37:51.086652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086475 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\") pod \"59bc3256-1f65-463f-824c-6a66d0c7f982\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " Oct 30 14:37:51.086652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086569 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\" (UniqueName: \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\") pod \"59bc3256-1f65-463f-824c-6a66d0c7f982\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " Oct 30 14:37:51.086652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086646 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") pod \"59bc3256-1f65-463f-824c-6a66d0c7f982\" (UID: \"59bc3256-1f65-463f-824c-6a66d0c7f982\") " Oct 30 14:37:51.086836 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086811 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca" pod "59bc3256-1f65-463f-824c-6a66d0c7f982" (UID: "59bc3256-1f65-463f-824c-6a66d0c7f982"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:37:51.086978 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.086955 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc3256-1f65-463f-824c-6a66d0c7f982-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:37:51.088849 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.088820 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls" pod "59bc3256-1f65-463f-824c-6a66d0c7f982" (UID: "59bc3256-1f65-463f-824c-6a66d0c7f982"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:37:51.088940 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.088858 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs" pod "59bc3256-1f65-463f-824c-6a66d0c7f982" (UID: "59bc3256-1f65-463f-824c-6a66d0c7f982"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:37:51.088984 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.088962 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v" pod "59bc3256-1f65-463f-824c-6a66d0c7f982" (UID: "59bc3256-1f65-463f-824c-6a66d0c7f982"). InnerVolumeSpecName "kube-api-access-tfh4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:37:51.187662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.187629 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:37:51.187662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.187656 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59bc3256-1f65-463f-824c-6a66d0c7f982-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:37:51.187662 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.187666 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfh4v\" (UniqueName: \"kubernetes.io/projected/59bc3256-1f65-463f-824c-6a66d0c7f982-kube-api-access-tfh4v\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:37:51.517392 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.517362 5768 generic.go:356] "Generic (PLEG): container finished" podID="59bc3256-1f65-463f-824c-6a66d0c7f982" containerID="5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124" exitCode=0 Oct 30 14:37:51.517588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.517408 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" Oct 30 14:37:51.517588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.517446 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" event={"ID":"59bc3256-1f65-463f-824c-6a66d0c7f982","Type":"ContainerDied","Data":"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124"} Oct 30 14:37:51.517588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.517495 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc" event={"ID":"59bc3256-1f65-463f-824c-6a66d0c7f982","Type":"ContainerDied","Data":"8a5214c5e8cad6e823ff2aa038be57581fa9e15a196c166dc150931442918568"} Oct 30 14:37:51.517588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.517517 5768 scope.go:122] "RemoveContainer" containerID="5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124" Oct 30 14:37:51.527251 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.527235 5768 scope.go:122] "RemoveContainer" containerID="5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124" Oct 30 14:37:51.527503 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:37:51.527488 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124\": container with ID starting with 5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124 not found: ID does not exist" containerID="5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124" Oct 30 14:37:51.527619 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.527510 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124"} err="failed to get container status \"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124\": rpc error: code = NotFound desc = could not find container \"5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124\": container with ID starting with 5410130c911ba309e40f200a93b626d5fb0acf882fc390ab9341a49345822124 not found: ID does not exist" Oct 30 14:37:51.571304 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.571279 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:37:51.575942 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:51.575922 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-e8c73c-77fdb869d4-4hqxc"] Oct 30 14:37:52.783720 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:52.783691 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59bc3256-1f65-463f-824c-6a66d0c7f982" path="/var/lib/kubelet/pods/59bc3256-1f65-463f-824c-6a66d0c7f982/volumes" Oct 30 14:37:57.601359 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:57.601325 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:57.763919 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:57.763886 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:37:57.966952 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:37:57.966907 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:01.844586 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:38:01.844530 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:38:02.673561 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.673513 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:38:02.674186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.674157 5768 cpu_manager.go:414] "containerMap: removing container" podUID="59bc3256-1f65-463f-824c-6a66d0c7f982" containerName="maas-api" Oct 30 14:38:02.674186 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.674181 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59bc3256-1f65-463f-824c-6a66d0c7f982" containerName="maas-api" Oct 30 14:38:02.674420 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.674321 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="59bc3256-1f65-463f-824c-6a66d0c7f982" containerName="maas-api" Oct 30 14:38:02.677802 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.677779 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.704463 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.704431 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-daa9ce43-kserve-self-signed-certs\"" Oct 30 14:38:02.707903 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.707874 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:38:02.782167 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.782133 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:02.799853 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.799831 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.799988 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.799892 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.800030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.799982 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.800030 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.800012 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sv47\" (UniqueName: \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.800133 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.800042 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.800189 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.800160 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.901652 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901615 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901664 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sv47\" (UniqueName: \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901708 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901734 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901798 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.901926 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902164 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.902125 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902408 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.902167 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.902408 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.902233 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.904097 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.904072 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.904639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.904618 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.925174 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.925113 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sv47\" (UniqueName: \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\") pod \"e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:02.996426 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:02.996398 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:03.297661 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:03.297586 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:38:03.302530 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:38:03.302497 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54e39257_6270_4d08_b2f8_73557d12781a.slice/crio-9bab7e326219f06e77f8ca655208718619686d92f2f47712e4c37977c6e97a41 WatchSource:0}: Error finding container 9bab7e326219f06e77f8ca655208718619686d92f2f47712e4c37977c6e97a41: Status 404 returned error can't find the container with id 9bab7e326219f06e77f8ca655208718619686d92f2f47712e4c37977c6e97a41 Oct 30 14:38:03.582098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:03.582013 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" event={"ID":"54e39257-6270-4d08-b2f8-73557d12781a","Type":"ContainerStarted","Data":"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8"} Oct 30 14:38:03.582098 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:03.582056 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" event={"ID":"54e39257-6270-4d08-b2f8-73557d12781a","Type":"ContainerStarted","Data":"9bab7e326219f06e77f8ca655208718619686d92f2f47712e4c37977c6e97a41"} Oct 30 14:38:03.624563 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:03.624511 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" podStartSLOduration=1.624495188 podStartE2EDuration="1.624495188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:38:03.62363047 +0000 UTC m=+1834.962429482" watchObservedRunningTime="2026-10-30 14:38:03.624495188 +0000 UTC m=+1834.963294251" Oct 30 14:38:03.997325 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:03.997289 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:12.997597 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:12.997543 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:13.010340 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:13.010314 5768 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:13.673349 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:13.673324 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:38:19.232139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:19.232105 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:20.158318 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:20.158290 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:21.119760 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:21.119709 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:27.288238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:27.288202 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:31.845374 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:38:31.845337 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:38:39.040573 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:39.037338 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:49.232715 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:49.232678 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:38:49.344378 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:49.344338 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:38:54.103005 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:38:54.102917 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:00.346567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:00.346504 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:00.510861 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:00.510822 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:01.958573 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:39:01.957729 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:39:04.253271 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.253215 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" podUID="54e39257-6270-4d08-b2f8-73557d12781a" containerName="main" containerID="cri-o://2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8" gracePeriod=45 Oct 30 14:39:04.501143 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.501118 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:39:04.534226 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.534162 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:04.609303 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609276 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\" (UniqueName: \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609314 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609368 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609392 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609425 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609483 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\" (UniqueName: \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\") pod \"54e39257-6270-4d08-b2f8-73557d12781a\" (UID: \"54e39257-6270-4d08-b2f8-73557d12781a\") " Oct 30 14:39:04.609723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609699 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:39:04.609723 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609712 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:39:04.609862 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609735 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:39:04.609899 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609886 5768 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-tmp-dir\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:04.609941 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609906 5768 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-model-cache\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:04.609941 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.609923 5768 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-home\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:04.611762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.611742 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:39:04.611857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.611767 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "kube-api-access-5sv47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:39:04.611857 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.611781 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm" pod "54e39257-6270-4d08-b2f8-73557d12781a" (UID: "54e39257-6270-4d08-b2f8-73557d12781a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 14:39:04.711419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.711387 5768 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e39257-6270-4d08-b2f8-73557d12781a-dshm\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:04.711419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.711418 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sv47\" (UniqueName: \"kubernetes.io/projected/54e39257-6270-4d08-b2f8-73557d12781a-kube-api-access-5sv47\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:04.711648 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:04.711432 5768 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e39257-6270-4d08-b2f8-73557d12781a-tls-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:05.176292 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.176261 5768 generic.go:356] "Generic (PLEG): container finished" podID="54e39257-6270-4d08-b2f8-73557d12781a" containerID="2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8" exitCode=0 Oct 30 14:39:05.176461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.176305 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" Oct 30 14:39:05.176461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.176351 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" event={"ID":"54e39257-6270-4d08-b2f8-73557d12781a","Type":"ContainerDied","Data":"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8"} Oct 30 14:39:05.176461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.176399 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn" event={"ID":"54e39257-6270-4d08-b2f8-73557d12781a","Type":"ContainerDied","Data":"9bab7e326219f06e77f8ca655208718619686d92f2f47712e4c37977c6e97a41"} Oct 30 14:39:05.176461 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.176417 5768 scope.go:122] "RemoveContainer" containerID="2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8" Oct 30 14:39:05.185462 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.185444 5768 scope.go:122] "RemoveContainer" containerID="2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8" Oct 30 14:39:05.185740 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:39:05.185722 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8\": container with ID starting with 2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8 not found: ID does not exist" containerID="2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8" Oct 30 14:39:05.185808 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.185749 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8"} err="failed to get container status \"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8\": rpc error: code = NotFound desc = could not find container \"2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8\": container with ID starting with 2a6c579c2bc5b1ee5bf5a27a13cde8d3915989822c6c3f7285e45723da2d18b8 not found: ID does not exist" Oct 30 14:39:05.227200 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.227169 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:39:05.238443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:05.238420 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-daa9ce43-kserve-77fc487577-smfwn"] Oct 30 14:39:06.782210 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:06.782173 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54e39257-6270-4d08-b2f8-73557d12781a" path="/var/lib/kubelet/pods/54e39257-6270-4d08-b2f8-73557d12781a/volumes" Oct 30 14:39:16.856574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:16.855656 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:31.844311 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:39:31.844275 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:39:33.938238 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.938200 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-v5s8k"] Oct 30 14:39:33.938752 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.938735 5768 cpu_manager.go:414] "containerMap: removing container" podUID="54e39257-6270-4d08-b2f8-73557d12781a" containerName="main" Oct 30 14:39:33.938752 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.938753 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54e39257-6270-4d08-b2f8-73557d12781a" containerName="main" Oct 30 14:39:33.938842 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.938835 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="54e39257-6270-4d08-b2f8-73557d12781a" containerName="main" Oct 30 14:39:33.943368 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.943349 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:33.971685 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:33.971658 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-v5s8k"] Oct 30 14:39:34.043018 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.042978 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be218725-50b2-4cb5-8d51-88e9bb7700ae-openshift-service-ca\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.043209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.043111 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-metrics-certs\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.043209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.043164 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-maas-api-tls\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.043209 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.043186 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xswf\" (UniqueName: \"kubernetes.io/projected/be218725-50b2-4cb5-8d51-88e9bb7700ae-kube-api-access-8xswf\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.144383 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.144341 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-maas-api-tls\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.144400 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xswf\" (UniqueName: \"kubernetes.io/projected/be218725-50b2-4cb5-8d51-88e9bb7700ae-kube-api-access-8xswf\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.144440 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be218725-50b2-4cb5-8d51-88e9bb7700ae-openshift-service-ca\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.144608 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.144581 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-metrics-certs\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.145241 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.145208 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be218725-50b2-4cb5-8d51-88e9bb7700ae-openshift-service-ca\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.146958 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.146930 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-maas-api-tls\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.147147 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.147129 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be218725-50b2-4cb5-8d51-88e9bb7700ae-metrics-certs\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.167749 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.167726 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xswf\" (UniqueName: \"kubernetes.io/projected/be218725-50b2-4cb5-8d51-88e9bb7700ae-kube-api-access-8xswf\") pod \"maas-api-595cc648c-v5s8k\" (UID: \"be218725-50b2-4cb5-8d51-88e9bb7700ae\") " pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.259256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.259174 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:34.561880 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.561784 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-595cc648c-v5s8k"] Oct 30 14:39:34.566006 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:39:34.565980 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe218725_50b2_4cb5_8d51_88e9bb7700ae.slice/crio-a75e9c712dfdb72b8a387b34377fda1db7808be758b8758fc085af8a9c07b042 WatchSource:0}: Error finding container a75e9c712dfdb72b8a387b34377fda1db7808be758b8758fc085af8a9c07b042: Status 404 returned error can't find the container with id a75e9c712dfdb72b8a387b34377fda1db7808be758b8758fc085af8a9c07b042 Oct 30 14:39:34.567256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:34.567234 5768 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 14:39:35.363998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:35.363904 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" event={"ID":"be218725-50b2-4cb5-8d51-88e9bb7700ae","Type":"ContainerStarted","Data":"c7c9093f33753c407c9a7fe07780ef9f6c7b086fe5560c56300faef994ff09fe"} Oct 30 14:39:35.363998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:35.363967 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" event={"ID":"be218725-50b2-4cb5-8d51-88e9bb7700ae","Type":"ContainerStarted","Data":"a75e9c712dfdb72b8a387b34377fda1db7808be758b8758fc085af8a9c07b042"} Oct 30 14:39:35.363998 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:35.363996 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:35.407641 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:35.407593 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" podStartSLOduration=2.057078976 podStartE2EDuration="2.407578747s" totalImagesPullingTime="350.499771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 14:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:39:35.406766343 +0000 UTC m=+1926.745565356" watchObservedRunningTime="2026-10-30 14:39:35.407578747 +0000 UTC m=+1926.746377756" Oct 30 14:39:39.175425 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:39.175388 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:41.377928 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:41.377901 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-595cc648c-v5s8k" Oct 30 14:39:41.455916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:41.455536 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:39:41.455916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:41.455820 5768 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" podUID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" containerName="maas-api" containerID="cri-o://62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713" gracePeriod=30 Oct 30 14:39:42.806077 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.806047 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:39:42.935316 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.935284 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\") pod \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " Oct 30 14:39:42.935639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.935332 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\") pod \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " Oct 30 14:39:42.935639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.935401 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\") pod \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " Oct 30 14:39:42.935639 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.935430 5768 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\" (UniqueName: \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\") pod \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\" (UID: \"a6a3170d-198a-4a6a-a53c-3146dd98d7ce\") " Oct 30 14:39:42.936404 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.936369 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca" pod "a6a3170d-198a-4a6a-a53c-3146dd98d7ce" (UID: "a6a3170d-198a-4a6a-a53c-3146dd98d7ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 14:39:42.939078 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.939049 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs" pod "a6a3170d-198a-4a6a-a53c-3146dd98d7ce" (UID: "a6a3170d-198a-4a6a-a53c-3146dd98d7ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:39:42.939419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.939399 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp" pod "a6a3170d-198a-4a6a-a53c-3146dd98d7ce" (UID: "a6a3170d-198a-4a6a-a53c-3146dd98d7ce"). InnerVolumeSpecName "kube-api-access-ngpbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 14:39:42.939515 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:42.939489 5768 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls" pod "a6a3170d-198a-4a6a-a53c-3146dd98d7ce" (UID: "a6a3170d-198a-4a6a-a53c-3146dd98d7ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 14:39:43.036915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.036877 5768 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-openshift-service-ca\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:43.036915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.036910 5768 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-maas-api-tls\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:43.036915 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.036922 5768 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-metrics-certs\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:43.037166 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.036934 5768 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngpbp\" (UniqueName: \"kubernetes.io/projected/a6a3170d-198a-4a6a-a53c-3146dd98d7ce-kube-api-access-ngpbp\") on node \"ip-10-0-130-107.ec2.internal\" DevicePath \"\"" Oct 30 14:39:43.421443 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.421401 5768 generic.go:356] "Generic (PLEG): container finished" podID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" containerID="62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713" exitCode=0 Oct 30 14:39:43.422028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.421474 5768 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" Oct 30 14:39:43.422028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.421588 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" event={"ID":"a6a3170d-198a-4a6a-a53c-3146dd98d7ce","Type":"ContainerDied","Data":"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713"} Oct 30 14:39:43.422028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.421637 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-tb25k" event={"ID":"a6a3170d-198a-4a6a-a53c-3146dd98d7ce","Type":"ContainerDied","Data":"c1cc62fa46ba67671c07478e81b0a0336d31331c32261af90261710cf9588dd8"} Oct 30 14:39:43.422028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.421668 5768 scope.go:122] "RemoveContainer" containerID="62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713" Oct 30 14:39:43.441256 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.441232 5768 scope.go:122] "RemoveContainer" containerID="62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713" Oct 30 14:39:43.441704 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:39:43.441661 5768 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713\": container with ID starting with 62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713 not found: ID does not exist" containerID="62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713" Oct 30 14:39:43.441820 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.441715 5768 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713"} err="failed to get container status \"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713\": rpc error: code = NotFound desc = could not find container \"62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713\": container with ID starting with 62d5b4ff90f18a093a989c9497ce5a230ea4dd766931779bd720af9180329713 not found: ID does not exist" Oct 30 14:39:43.476769 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.476727 5768 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:39:43.486826 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:43.486794 5768 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-tb25k"] Oct 30 14:39:44.799574 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:44.797841 5768 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" path="/var/lib/kubelet/pods/a6a3170d-198a-4a6a-a53c-3146dd98d7ce/volumes" Oct 30 14:39:52.871575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:52.870820 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:39:53.026575 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:39:53.025700 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:40:01.846904 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:40:01.846863 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:40:31.844204 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:40:31.844166 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:40:32.320091 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:32.320063 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f74d955b-rmg54_7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4/authorino/0.log" Oct 30 14:40:34.478563 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:34.478165 5768 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-296vj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 14:40:34.478563 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:34.478235 5768 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-296vj" podUID="6985d4d4-559e-489d-a407-d4ef2c0944b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 14:40:39.291419 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:39.291320 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:40:42.756793 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:42.756762 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-685fc76c5-7qqzk_4e3fb7b2-eed6-4912-9424-3e71e12fdd69/manager/0.log" Oct 30 14:40:44.992351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:44.992319 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-n4sh8_4f0ef27a-6b93-408c-a44e-7f285e082a15/copy-manifests/0.log" Oct 30 14:40:45.023689 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:45.023651 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-n4sh8_4f0ef27a-6b93-408c-a44e-7f285e082a15/manager/0.log" Oct 30 14:40:46.461501 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:46.461468 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-v5s8k_be218725-50b2-4cb5-8d51-88e9bb7700ae/maas-api/0.log" Oct 30 14:40:48.365661 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:48.365632 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-7bw4n_76b43768-28e3-42d6-b723-052aae311863/postgres/0.log" Oct 30 14:40:49.828111 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:49.828075 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f74d955b-rmg54_7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4/authorino/0.log" Oct 30 14:40:50.477813 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:50.477787 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vvm7g_200b89d1-dfac-4f00-b8a9-6f764ef674df/kuadrant-console-plugin/0.log" Oct 30 14:40:52.505138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:52.505113 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-847b5f84b8-tx5r8_20fd2942-cf8b-456c-a7f8-309b24260c80/kube-auth-proxy/0.log" Oct 30 14:40:52.695034 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:52.695000 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-296vj_6985d4d4-559e-489d-a407-d4ef2c0944b1/istio-proxy/0.log" Oct 30 14:40:53.278168 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:53.278142 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-n4dtm_44e4e58d-16eb-4e7a-b33e-b6c3b9844777/istio-proxy/0.log" Oct 30 14:40:53.493683 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:53.493654 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-pc4s6_5cccb5d9-5411-495e-9681-e667802c8bc1/istio-proxy/0.log" Oct 30 14:40:53.907170 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:53.907140 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-sz9hx_6c2f65b1-0983-4cdb-9405-894e69601e34/istio-proxy/0.log" Oct 30 14:40:54.677936 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:54.677912 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-n7zn7_61464ddd-b20c-41cf-b1f7-9c8aace04636/payload-pre-processing/0.log" Oct 30 14:40:56.194565 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:56.194522 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9rw47_1bb14377-9f18-48e5-b7c5-52fd291c2112/main/0.log" Oct 30 14:40:56.393997 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:56.393972 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-2qwc8_0a33cb23-f9aa-4ac6-81f6-743d759f3bd3/main/0.log" Oct 30 14:40:56.962351 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:56.962325 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7_004699c9-5fa9-4e2c-aa35-3d47bec3402a/main/0.log" Oct 30 14:40:57.159113 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:57.159082 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq_d7f770d8-4f3b-4c56-b862-09475a86e8bc/main/0.log" Oct 30 14:40:58.020478 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:40:58.020452 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f74d955b-rmg54_7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4/authorino/0.log" Oct 30 14:41:01.844665 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:41:01.844630 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:41:07.021028 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:07.020994 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-685fc76c5-7qqzk_4e3fb7b2-eed6-4912-9424-3e71e12fdd69/manager/0.log" Oct 30 14:41:09.045727 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:09.045690 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-n4sh8_4f0ef27a-6b93-408c-a44e-7f285e082a15/copy-manifests/0.log" Oct 30 14:41:09.073762 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:09.073731 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6749b785b4-n4sh8_4f0ef27a-6b93-408c-a44e-7f285e082a15/manager/0.log" Oct 30 14:41:10.260922 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:10.260889 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-595cc648c-v5s8k_be218725-50b2-4cb5-8d51-88e9bb7700ae/maas-api/0.log" Oct 30 14:41:12.319315 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:12.319285 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-7bw4n_76b43768-28e3-42d6-b723-052aae311863/postgres/0.log" Oct 30 14:41:13.404916 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:13.404888 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f74d955b-rmg54_7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4/authorino/0.log" Oct 30 14:41:14.028734 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:14.028706 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vvm7g_200b89d1-dfac-4f00-b8a9-6f764ef674df/kuadrant-console-plugin/0.log" Oct 30 14:41:15.841907 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:15.841877 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-847b5f84b8-tx5r8_20fd2942-cf8b-456c-a7f8-309b24260c80/kube-auth-proxy/0.log" Oct 30 14:41:16.046814 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:16.046778 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-296vj_6985d4d4-559e-489d-a407-d4ef2c0944b1/istio-proxy/0.log" Oct 30 14:41:16.659451 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:16.659420 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-n4dtm_44e4e58d-16eb-4e7a-b33e-b6c3b9844777/istio-proxy/0.log" Oct 30 14:41:16.861244 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:16.861216 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-pc4s6_5cccb5d9-5411-495e-9681-e667802c8bc1/istio-proxy/0.log" Oct 30 14:41:17.285897 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:17.285868 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-sz9hx_6c2f65b1-0983-4cdb-9405-894e69601e34/istio-proxy/0.log" Oct 30 14:41:18.122323 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:18.122289 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-n7zn7_61464ddd-b20c-41cf-b1f7-9c8aace04636/payload-pre-processing/0.log" Oct 30 14:41:19.219557 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:19.219529 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-9rw47_1bb14377-9f18-48e5-b7c5-52fd291c2112/main/0.log" Oct 30 14:41:19.444540 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:19.444515 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-2qwc8_0a33cb23-f9aa-4ac6-81f6-743d759f3bd3/main/0.log" Oct 30 14:41:20.028738 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:20.028707 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-r75m7_004699c9-5fa9-4e2c-aa35-3d47bec3402a/main/0.log" Oct 30 14:41:20.226559 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:20.226514 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-w5nhq_d7f770d8-4f3b-4c56-b862-09475a86e8bc/main/0.log" Oct 30 14:41:31.844739 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:41:31.844696 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:41:39.424929 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:41:39.424892 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:42:01.844824 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:42:01.844779 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:42:18.747894 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:18.747830 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:42:31.844441 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:42:31.844401 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:42:39.560441 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:39.560405 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:42:45.033260 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:45.033219 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:42:46.152818 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:46.152772 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:42:49.429892 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:49.429860 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjb5h_e02852b9-75b7-45be-9bda-657470e970e5/global-pull-secret-syncer/0.log" Oct 30 14:42:50.686413 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:50.686378 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" Oct 30 14:42:51.298328 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:51.298299 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-107.ec2.internal_22a8f48498ec66db0afb340acba0d0bb/haproxy/0.log" Oct 30 14:42:57.057588 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:57.057529 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68f74d955b-rmg54_7373bb1e-e404-44bc-b51a-c5ec4ae0f2c4/authorino/0.log" Oct 30 14:42:57.439268 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:57.439242 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vvm7g_200b89d1-dfac-4f00-b8a9-6f764ef674df/kuadrant-console-plugin/0.log" Oct 30 14:42:59.466825 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.466796 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/alertmanager/0.log" Oct 30 14:42:59.589606 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.589576 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/config-reloader/0.log" Oct 30 14:42:59.640014 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.639981 5768 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws"] Oct 30 14:42:59.640664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.640592 5768 cpu_manager.go:414] "containerMap: removing container" podUID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" containerName="maas-api" Oct 30 14:42:59.640664 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.640616 5768 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" containerName="maas-api" Oct 30 14:42:59.640840 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.640722 5768 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6a3170d-198a-4a6a-a53c-3146dd98d7ce" containerName="maas-api" Oct 30 14:42:59.644138 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.644120 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.664918 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.664893 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws"] Oct 30 14:42:59.671386 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.671359 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qw6xv\"/\"openshift-service-ca.crt\"" Oct 30 14:42:59.671582 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.671539 5768 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qw6xv\"/\"kube-root-ca.crt\"" Oct 30 14:42:59.671722 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.671704 5768 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qw6xv\"/\"default-dockercfg-vfvlx\"" Oct 30 14:42:59.716071 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.716041 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/kube-rbac-proxy-web/0.log" Oct 30 14:42:59.803276 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.803192 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-proc\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.803276 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.803254 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-sys\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.803486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.803357 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnj6p\" (UniqueName: \"kubernetes.io/projected/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-kube-api-access-xnj6p\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.803486 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.803393 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-lib-modules\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.803623 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.803514 5768 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-podres\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.839589 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.839540 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/kube-rbac-proxy/0.log" Oct 30 14:42:59.904712 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904680 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-sys\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.904888 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904775 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-sys\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.904888 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904779 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnj6p\" (UniqueName: \"kubernetes.io/projected/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-kube-api-access-xnj6p\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.904888 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904841 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-lib-modules\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.905069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904911 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-podres\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.905069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.904956 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-lib-modules\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.905069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.905002 5768 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-proc\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.905069 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.905045 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-podres\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.905289 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.905175 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-proc\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.928139 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.928115 5768 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnj6p\" (UniqueName: \"kubernetes.io/projected/c4d6148e-bdd4-4999-8b8c-2acb68da0c74-kube-api-access-xnj6p\") pod \"perf-node-gather-daemonset-b8pws\" (UID: \"c4d6148e-bdd4-4999-8b8c-2acb68da0c74\") " pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.959686 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.959666 5768 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:42:59.966867 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:42:59.966843 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/kube-rbac-proxy-metric/0.log" Oct 30 14:43:00.093643 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.093574 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/prom-label-proxy/0.log" Oct 30 14:43:00.216135 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.216106 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_421c185c-02d5-4cee-97ff-446d8f038fcb/init-config-reloader/0.log" Oct 30 14:43:00.266089 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.266057 5768 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws"] Oct 30 14:43:00.270175 ip-10-0-130-107 kubenswrapper[5768]: W1030 14:43:00.270151 5768 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc4d6148e_bdd4_4999_8b8c_2acb68da0c74.slice/crio-47782d18f38c0681628f1b41ff0e660e490b4bbb65eeba5589172e45b0c215bd WatchSource:0}: Error finding container 47782d18f38c0681628f1b41ff0e660e490b4bbb65eeba5589172e45b0c215bd: Status 404 returned error can't find the container with id 47782d18f38c0681628f1b41ff0e660e490b4bbb65eeba5589172e45b0c215bd Oct 30 14:43:00.484283 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.484249 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5cgkm_b231cb54-6891-40d2-a5a3-9833dd201dc4/kube-state-metrics/0.log" Oct 30 14:43:00.582010 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.581972 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" event={"ID":"c4d6148e-bdd4-4999-8b8c-2acb68da0c74","Type":"ContainerStarted","Data":"eeb83e404d7c4fb3cc60451d60d9a6c403a0787c8a630a1a83fe82774df45cbf"} Oct 30 14:43:00.582180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.582022 5768 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" event={"ID":"c4d6148e-bdd4-4999-8b8c-2acb68da0c74","Type":"ContainerStarted","Data":"47782d18f38c0681628f1b41ff0e660e490b4bbb65eeba5589172e45b0c215bd"} Oct 30 14:43:00.582180 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.582053 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:43:00.624567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.624467 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5cgkm_b231cb54-6891-40d2-a5a3-9833dd201dc4/kube-rbac-proxy-main/0.log" Oct 30 14:43:00.634535 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.634496 5768 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" podStartSLOduration=1.634484963 podStartE2EDuration="1.634484963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 14:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 14:43:00.633609807 +0000 UTC m=+2131.972408820" watchObservedRunningTime="2026-10-30 14:43:00.634484963 +0000 UTC m=+2131.973283973" Oct 30 14:43:00.748538 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.748508 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-5cgkm_b231cb54-6891-40d2-a5a3-9833dd201dc4/kube-rbac-proxy-self/0.log" Oct 30 14:43:00.876363 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:00.876281 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c5b5ccdfc-rs2s5_23119be2-4439-4880-980b-8c1b7c2458f1/metrics-server/0.log" Oct 30 14:43:01.006694 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:01.006663 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-v9s66_9d5d2eb1-be5e-4d23-91d8-7bcfd4031baa/monitoring-plugin/0.log" Oct 30 14:43:01.508976 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:01.508943 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwhkm_371c1a73-c9ec-4d40-abf7-e9fad245c336/node-exporter/0.log" Oct 30 14:43:01.632400 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:01.632373 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwhkm_371c1a73-c9ec-4d40-abf7-e9fad245c336/kube-rbac-proxy/0.log" Oct 30 14:43:01.752539 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:01.752513 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwhkm_371c1a73-c9ec-4d40-abf7-e9fad245c336/init-textfile/0.log" Oct 30 14:43:01.845106 ip-10-0-130-107 kubenswrapper[5768]: E1030 14:43:01.845031 5768 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-cqvhx" containerName="extractor" Oct 30 14:43:02.277046 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:02.276993 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-wr2qn_c1146185-f6e9-4b71-aba3-95b45c7777ed/kube-rbac-proxy-main/0.log" Oct 30 14:43:02.398275 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:02.398244 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-wr2qn_c1146185-f6e9-4b71-aba3-95b45c7777ed/kube-rbac-proxy-self/0.log" Oct 30 14:43:02.518510 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:02.518478 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-wr2qn_c1146185-f6e9-4b71-aba3-95b45c7777ed/openshift-state-metrics/0.log" Oct 30 14:43:03.539016 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:03.538977 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-vhtr5_e9456444-ffe3-4bca-9b6c-3f13fbc507d0/prometheus-operator/0.log" Oct 30 14:43:03.655312 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:03.655272 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-vhtr5_e9456444-ffe3-4bca-9b6c-3f13fbc507d0/kube-rbac-proxy/0.log" Oct 30 14:43:03.911105 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:03.911025 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bd744f69b-hjb9b_dcab3e80-454e-48c4-a198-1ac9a9e9425b/telemeter-client/0.log" Oct 30 14:43:04.031732 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:04.031702 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bd744f69b-hjb9b_dcab3e80-454e-48c4-a198-1ac9a9e9425b/reload/0.log" Oct 30 14:43:04.153819 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:04.153787 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bd744f69b-hjb9b_dcab3e80-454e-48c4-a198-1ac9a9e9425b/kube-rbac-proxy/0.log" Oct 30 14:43:06.597074 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:06.597047 5768 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qw6xv/perf-node-gather-daemonset-b8pws" Oct 30 14:43:08.767020 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:08.766993 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c7dfcdb7-r56ck_3566f4ef-8f6f-453d-a776-ac5332c2c2ff/console/0.log" Oct 30 14:43:11.816616 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:11.816584 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:43:11.960850 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:11.960823 5768 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c558z_dfa727ec-4c77-4e70-ad45-9628aff7ce9d/konnectivity-agent/0.log" limit=1024 Oct 30 14:43:13.134454 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.134426 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mcw8d_9d6d62da-35a7-4b2d-b528-453701e00b5f/dns/0.log" Oct 30 14:43:13.262816 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.262783 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mcw8d_9d6d62da-35a7-4b2d-b528-453701e00b5f/kube-rbac-proxy/0.log" Oct 30 14:43:13.636129 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.636105 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7kq6l_12480bb8-63a0-46b7-8c80-77a003039963/dns-node-resolver/0.log" Oct 30 14:43:13.671202 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.671175 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-847b5f84b8-tx5r8_20fd2942-cf8b-456c-a7f8-309b24260c80/kube-auth-proxy/0.log" Oct 30 14:43:13.741264 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.741232 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-296vj_6985d4d4-559e-489d-a407-d4ef2c0944b1/istio-proxy/0.log" Oct 30 14:43:13.926291 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.926267 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-n4dtm_44e4e58d-16eb-4e7a-b33e-b6c3b9844777/istio-proxy/0.log" Oct 30 14:43:13.992017 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:13.991990 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-pc4s6_5cccb5d9-5411-495e-9681-e667802c8bc1/istio-proxy/0.log" Oct 30 14:43:14.130257 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:14.130219 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-sz9hx_6c2f65b1-0983-4cdb-9405-894e69601e34/istio-proxy/0.log" Oct 30 14:43:14.401864 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:14.401795 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-n7zn7_61464ddd-b20c-41cf-b1f7-9c8aace04636/payload-pre-processing/0.log" Oct 30 14:43:15.309567 ip-10-0-130-107 kubenswrapper[5768]: I1030 14:43:15.309522 5768 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvjpk_210c5840-d339-472c-bf93-70d3b994ef0b/node-ca/0.log"