Jul 15 19:38:36.493752 ip-10-0-141-1 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 19:38:36.842135 ip-10-0-141-1 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:36.842135 ip-10-0-141-1 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 19:38:36.842135 ip-10-0-141-1 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:36.842135 ip-10-0-141-1 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 19:38:36.842135 ip-10-0-141-1 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:36.843832 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.843749    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850716    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850735    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850738    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850742    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850745    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.850739 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850748    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850751    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850754    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850757    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850761    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850763    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850771    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850774    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850776    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850779    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850782    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850784    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850787    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850789    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850792    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850795    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850798    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850800    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850803    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.850961 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850805    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850808    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850810    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850813    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850815    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850817    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850820    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850822    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850827    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850830    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850832    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850835    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850837    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850840    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850843    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850846    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850849    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850852    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850854    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850857    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.851443 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850860    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850862    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850865    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850869    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850873    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850876    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850879    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850882    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850885    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850887    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850890    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850892    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850894    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850898    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850902    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850905    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850909    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850913    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.851951 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850916    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850919    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850922    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850924    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850926    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850929    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850931    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850933    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850937    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850940    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850943    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850946    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850948    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850951    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850953    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850955    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850958    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850960    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850963    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850966    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.852385 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850968    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850972    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850974    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850977    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850980    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850982    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850984    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850987    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850989    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850992    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850994    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850996    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.850999    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851001    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851004    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851006    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851008    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851729    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851735    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851738    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.852894 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851742    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851745    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851748    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851752    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851756    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851759    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851762    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851766    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851769    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851771    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851774    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851776    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851779    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851781    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851785    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851787    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851790    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851792    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851795    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851798    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.853381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851800    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851802    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851805    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851807    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851809    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851812    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851814    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851817    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851819    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851822    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851824    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851829    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851832    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851837    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851840    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851843    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851845    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851848    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851850    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851853    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.853926 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851855    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851858    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851860    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851862    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851867    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851870    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851873    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851877    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851880    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851883    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851885    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851888    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851890    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851893    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851895    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851898    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851900    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851903    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851905    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.854425 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851908    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851910    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851913    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851915    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851917    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851920    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851925    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851927    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851930    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851933    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851935    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851938    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851940    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851943    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851945    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851947    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851950    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851953    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851955    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.854911 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851958    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851970    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851973    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851975    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851977    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851980    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851982    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851985    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851988    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851990    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851992    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851995    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.851997    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852000    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852002    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852004    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852007    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852464    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852472    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.855381 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852495    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852499    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852502    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852505    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852508    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852511    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852513    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852516    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852518    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852521    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852524    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852528    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852531    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852533    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852536    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852539    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852542    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852544    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852547    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852550    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.855884 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852552    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852554    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852557    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852559    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852562    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852564    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852566    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852569    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852571    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852574    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852576    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852580    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852583    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852585    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852588    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852590    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852592    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852595    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852597    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852600    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.856365 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852602    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852605    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852607    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852611    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852614    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852617    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852621    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852624    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852627    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852630    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852633    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852635    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852637    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852640    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852643    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852645    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852647    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852652    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852655    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.856874 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852657    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852660    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852662    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852665    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852668    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852671    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852675    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852678    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852681    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852683    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852686    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852689    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852692    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852694    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852697    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852699    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852703    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852706    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852709    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.857334 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852713    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852715    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852719    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852721    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852724    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852726    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852729    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852732    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852734    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852737    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852739    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852742    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852744    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852746    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852749    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852751    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852754    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852757    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.852760    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852825    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852834    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 19:38:36.857798 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852844    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852851    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852864    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852869    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852873    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852877    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852880    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852883    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852888    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852891    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852894    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852897    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852900    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852903    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852907    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852910    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852941    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852944    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852947    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852951    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852954    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852958    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852961    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 19:38:36.858308 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852964    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852968    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852971    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852974    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852977    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852980    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852983    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852987    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852990    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852993    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852996    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.852999    2580 flags.go:64] FLAG: --enable-server="true"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853001    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853005    2580 flags.go:64] FLAG: --event-burst="100"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853008    2580 flags.go:64] FLAG: --event-qps="50"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853011    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853014    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853018    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853021    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853024    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853027    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853030    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853033    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853035    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853039    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 19:38:36.858879 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853041    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853044    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853047    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853050    2580 flags.go:64] FLAG: --feature-gates=""
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853053    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853056    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853059    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853062    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853065    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853067    2580 flags.go:64] FLAG: --help="false"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853070    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-141-1.ec2.internal"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853073    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853076    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853079    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853082    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853086    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853089    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853091    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853094    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853097    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853100    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853103    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853105    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853108    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 19:38:36.859576 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853112    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853115    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853118    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853121    2580 flags.go:64] FLAG: --lock-file=""
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853123    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853126    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853129    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853134    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853138    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853141    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853143    2580 flags.go:64] FLAG: --logging-format="text"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853146    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853150    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853152    2580 flags.go:64] FLAG: --manifest-url=""
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853155    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853159    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853162    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853166    2580 flags.go:64] FLAG: --max-pods="110"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853169    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853172    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853175    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853177    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853180    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853183    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853186    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 19:38:36.860457 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853193    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853196    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853199    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853202    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853204    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853209    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853212    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853216    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853219    2580 flags.go:64] FLAG: --port="10250"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853221    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853224    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02053ca45e0b0631d"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853227    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853230    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853232    2580 flags.go:64] FLAG: --register-node="true"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853235    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853238    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853242    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853244    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853247    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853250    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853253    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853256    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853259    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853261    2580 flags.go:64] FLAG: --runonce="false"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853264    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 19:38:36.861551 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853267    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853270    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853272    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853275    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853278    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853281    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853284    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853286    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853289    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853292    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853294    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853297    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853300    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853303    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853309    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853312    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853314    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853319    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853322    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853324    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853330    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853333    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853336    2580 flags.go:64] FLAG: --v="2"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853340    2580 flags.go:64] FLAG: --version="false"
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853344    2580 flags.go:64] FLAG: --vmodule=""
Jul 15 19:38:36.862629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853348    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.853351    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853495    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853501    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853504    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853507    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853510    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853512    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853515    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853517    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853523    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853525    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853528    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853530    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853533    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853536    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853538    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853540    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853543    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853545    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.863755 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853548    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853553    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853557    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853560    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853562    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853565    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853567    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853570    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853573    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853575    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853578    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853580    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853584    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853586    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853588    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853592    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853596    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853599    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853601    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.864302 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853604    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853607    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853609    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853613    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853615    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853618    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853620    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853623    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853625    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853629    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853631    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853633    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853636    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853639    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853644    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853648    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853651    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853654    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853656    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853659    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.865137 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853662    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853665    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853667    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853670    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853672    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853675    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853678    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853681    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853684    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853686    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853688    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853691    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853693    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853696    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853698    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853702    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853704    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853707    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853709    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853712    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.865963 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853714    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853717    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853719    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853722    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853724    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853727    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853731    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853733    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853736    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853738    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853740    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853743    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853745    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853747    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853750    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853752    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853755    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853757    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853760    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853762    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.866633 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853765    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.853767    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.854342    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.862042    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.862066    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.862093    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.862102    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862220    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862229    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862235    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862240    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862244    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862249    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862254    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.867166 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862258    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862263    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862268    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862271    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862281    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862285    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862289    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862294    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862298    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862302    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862306    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862310    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862314    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862319    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862323    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862327    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862331    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862335    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862339    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.867582 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862343    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862348    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862354    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862358    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862362    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862367    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862371    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862375    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862379    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862383    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862387    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862391    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862396    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862400    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862404    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862410    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862416    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862421    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.868106 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862426    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862432    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862437    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862442    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862447    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862452    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862457    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862461    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862465    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862471    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862495    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862500    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862505    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862509    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862513    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862517    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862521    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862526    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862531    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862535    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.868575 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862539    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862543    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862547    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862551    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862556    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862560    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862564    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862568    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862573    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862576    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862581    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862585    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862589    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862593    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862598    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862602    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862606    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862610    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862614    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862618    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.869100 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862623    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862627    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862631    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862635    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862639    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862643    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862646    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862652    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862659    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862663    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862668    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862673    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862677    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862681    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.862688    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:36.869611 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862868    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862876    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862882    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862886    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862891    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862895    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862900    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862905    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862910    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862914    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862919    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862923    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862928    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862932    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862936    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862940    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862944    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862948    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862953    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:36.870052 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862959    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862963    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862968    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862972    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862976    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862980    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862985    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862989    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862993    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.862998    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863002    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863006    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863010    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863014    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863018    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863021    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863025    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863029    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863032    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863035    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:36.870574 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863039    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863043    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863047    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863050    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863054    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863058    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863061    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863065    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863068    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863072    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863076    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863080    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863084    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863088    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863092    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863097    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863102    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863107    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863110    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863114    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:36.871054 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863118    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863122    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863127    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863132    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863137    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863144    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863148    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863153    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863158    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863162    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863167    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863171    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863175    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863179    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863183    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863187    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863191    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863195    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863199    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:36.871849 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863204    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863208    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863212    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863216    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863220    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863224    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863228    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863232    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863237    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863241    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863245    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863249    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863253    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863257    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863261    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863266    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863271    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863276    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863280    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863284    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:36.872373 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:36.863288    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.863295    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.863453    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.866344    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.867923    2580 server.go:1019] "Starting client certificate rotation"
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.868031    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.868071    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:38:36.872919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.871767    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:38:36.874632 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.874612    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:38:36.888303 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.888280    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 15 19:38:36.890415 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.890402    2580 log.go:25] "Validated CRI v1 image API"
Jul 15 19:38:36.891191 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.891177    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 19:38:36.894735 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.894717    2580 fs.go:135] Filesystem UUIDs: map[6049a30f-385f-4b21-8b9c-6e0d5e0ce9f3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c6b2a403-2d0f-4186-b2d7-3f5d039d07f8:/dev/nvme0n1p3]
Jul 15 19:38:36.894785 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.894735    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 19:38:36.898898 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.898883    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:38:36.899905 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.899794    2580 manager.go:216] Machine: {Timestamp:2026-07-15 19:38:36.898524459 +0000 UTC m=+0.301905086 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099543 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f8f94a8453efb128994c20c5bc1df SystemUUID:ec2f8f94-a845-3efb-1289-94c20c5bc1df BootID:6fc3c92a-218e-40b9-b0bd-5b6d6119c9ba Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:f1:93:ea:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:f1:93:ea:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:1c:6b:2b:a7:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 19:38:36.899905 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.899904    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 19:38:36.899990 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.899979    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 19:38:36.903179 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.903152    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 19:38:36.903314 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.903180    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 19:38:36.903774 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.903763    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 19:38:36.903827 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.903776    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 19:38:36.903827 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.903784    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:38:36.904448 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.904438    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:38:36.906109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.906099    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 19:38:36.909367 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909356    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:38:36.909504 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909494    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 19:38:36.909542 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909530    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 19:38:36.909574 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909550    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 19:38:36.909574 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909565    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 19:38:36.909574 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909574    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 15 19:38:36.909703 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909582    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 19:38:36.909974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909953    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:38:36.909974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.909977    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:38:36.911982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.911959    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 19:38:36.913995 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.913982    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 19:38:36.914042 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914012    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 19:38:36.914173 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914163    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 19:38:36.914229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914178    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 19:38:36.914229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914184    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 19:38:36.914229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914189    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 19:38:36.914229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914197    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 19:38:36.914229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914212    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 19:38:36.914650 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914641    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 19:38:36.914687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914650    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 19:38:36.914687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914658    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 19:38:36.914687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914664    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 19:38:36.914687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914678    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 19:38:36.914687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.914685    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 19:38:36.915369 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.915358    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 19:38:36.915369 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.915368    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 19:38:36.918813 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.918799    2580 server.go:1268] "Started kubelet"
Jul 15 19:38:36.918913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.918886    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 19:38:36.921345 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.921286    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 19:38:36.921425 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.921373    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 19:38:36.921652 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.921619    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 19:38:36.921792 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.921777    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 19:38:36.921859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.921848    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 19:38:36.922920 ip-10-0-141-1 systemd[1]: Started Kubernetes Kubelet.
Jul 15 19:38:36.924635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.923963    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 19:38:36.925096 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.925080    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 19:38:36.927375 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.926607    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-1.ec2.internal.18c28dcdadf9b1bb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-1.ec2.internal,UID:ip-10-0-141-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-1.ec2.internal,},FirstTimestamp:2026-07-15 19:38:36.918772155 +0000 UTC m=+0.322152781,LastTimestamp:2026-07-15 19:38:36.918772155 +0000 UTC m=+0.322152781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-1.ec2.internal,}"
Jul 15 19:38:36.928138 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.928120    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 19:38:36.931728 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.931711    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 19:38:36.931832 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.931730    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 19:38:36.931890 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.931844    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:36.932517 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.932407    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 19:38:36.932517 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.932431    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 19:38:36.932517 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.932441    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 19:38:36.932695 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.932579    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 19:38:36.932695 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.932587    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 19:38:36.933177 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933157    2580 factory.go:55] Registering systemd factory
Jul 15 19:38:36.933255 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933180    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 15 19:38:36.933402 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933380    2580 factory.go:153] Registering CRI-O factory
Jul 15 19:38:36.933402 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933399    2580 factory.go:223] Registration of the crio container factory successfully
Jul 15 19:38:36.933520 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933446    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 19:38:36.933520 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933498    2580 factory.go:103] Registering Raw factory
Jul 15 19:38:36.933520 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933515    2580 manager.go:1196] Started watching for new ooms in manager
Jul 15 19:38:36.933960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.933941    2580 manager.go:349] Starting recovery of all containers
Jul 15 19:38:36.937822 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.937795    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pjrtn"
Jul 15 19:38:36.943898 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.943750    2580 manager.go:354] Recovery completed
Jul 15 19:38:36.944146 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.944125    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pjrtn"
Jul 15 19:38:36.946887 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.946866    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 19:38:36.946979 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.946883    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 19:38:36.948848 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.948836    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:36.950693 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.950677    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:36.950762 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.950701    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:36.950762 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.950711    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:36.951250 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951231    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 19:38:36.951250 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951250    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 19:38:36.951375 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951255    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:36.951375 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951269    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:38:36.951937 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951924    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:36.952002 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951951    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:36.952002 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.951964    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:36.952311 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.952301    2580 policy_none.go:49] "None policy: Start"
Jul 15 19:38:36.952349 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.952317    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 19:38:36.952349 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.952326    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 19:38:36.953392 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.953382    2580 policy_none.go:47] "Start"
Jul 15 19:38:36.991096 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991076    2580 manager.go:337] "Starting Device Plugin manager"
Jul 15 19:38:36.991221 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.991116    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 19:38:36.991221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991129    2580 server.go:87] "Starting device plugin registration server"
Jul 15 19:38:36.991411 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991398    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 19:38:36.991469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991413    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 19:38:36.991542 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991514    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 19:38:36.991625 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991609    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 19:38:36.991625 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:36.991622    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 19:38:36.992087 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.992067    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 19:38:36.992156 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:36.992125    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.091941 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.091898    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:37.093140 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.092962    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:37.093140 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.092991    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:37.093140 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.093007    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:37.093140 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.093038    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.101750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.101732    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.101804 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.101755    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-1.ec2.internal\": node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.109994 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.109969    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 19:38:37.111352 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.111335    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 19:38:37.111414 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.111380    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 19:38:37.111414 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.111405    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 19:38:37.111506 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.111443    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 19:38:37.113652 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.113624    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:37.120329 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.120313    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.212465 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.212413    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"]
Jul 15 19:38:37.212617 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.212541    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:37.214169 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.214153    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:37.214229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.214188    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:37.214229 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.214209    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:37.215459 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.215447    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:37.215599 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.215583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.215634 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.215615    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:37.216163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216149    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:37.216220 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216175    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:37.216220 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216186    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:37.216299 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216261    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:37.216299 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216289    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:37.216299 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.216298    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:37.217665 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.217650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.217746 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.217680    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:37.218331 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.218316    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:37.218412 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.218336    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:37.218412 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.218349    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:37.220638 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.220621    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.233683 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.233661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.233758 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.233689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e403cd9bea9a483eb12fa077866f3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"c7e403cd9bea9a483eb12fa077866f3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.233758 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.233706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.245983 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.245961    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.250180 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.250163    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-1.ec2.internal\" not found" node="ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.321586 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.321558    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.333900 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e403cd9bea9a483eb12fa077866f3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"c7e403cd9bea9a483eb12fa077866f3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.333963 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.333963 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.334024 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.334024 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/227c6777e0634aba2eac3313d628eb57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal\" (UID: \"227c6777e0634aba2eac3313d628eb57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.334024 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.333997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c7e403cd9bea9a483eb12fa077866f3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-1.ec2.internal\" (UID: \"c7e403cd9bea9a483eb12fa077866f3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.422395 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.422326    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.522872 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.522832    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.548388 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.548360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.554535 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.554513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:37.623224 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.623176    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.723863 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.723787    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.824319 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.824278    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.866928 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.866900    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 19:38:37.867297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.867052    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:38:37.906351 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.906326    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:37.924462 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:37.924439    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:37.926967 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.926951    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:37.948112 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.948082    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:33:37 +0000 UTC" deadline="2028-01-24 12:32:00.629574171 +0000 UTC"
Jul 15 19:38:37.948112 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:37.948106    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13384h53m22.681471389s"
Jul 15 19:38:38.025583 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.025442    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:38.126497 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.126196    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:38.224253 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:38.224220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227c6777e0634aba2eac3313d628eb57.slice/crio-a020abb24fcb8dfb884d0cbf86412902f42a946471ac23d1312efb5c8977f362 WatchSource:0}: Error finding container a020abb24fcb8dfb884d0cbf86412902f42a946471ac23d1312efb5c8977f362: Status 404 returned error can't find the container with id a020abb24fcb8dfb884d0cbf86412902f42a946471ac23d1312efb5c8977f362
Jul 15 19:38:38.226362 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.226338    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:38.231017 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.230998    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:38:38.326642 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.326542    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-1.ec2.internal\" not found"
Jul 15 19:38:38.355471 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.355450    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:38.432172 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.432137    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:38.448347 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.448329    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:38:38.449333 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.449320    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal"
Jul 15 19:38:38.459337 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.459321    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:38:38.633873 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:38.633848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e403cd9bea9a483eb12fa077866f3f.slice/crio-a1e2a319421c461239e88bdb8922c71720d0b74fb732e776ff7f2998dabb28ba WatchSource:0}: Error finding container a1e2a319421c461239e88bdb8922c71720d0b74fb732e776ff7f2998dabb28ba: Status 404 returned error can't find the container with id a1e2a319421c461239e88bdb8922c71720d0b74fb732e776ff7f2998dabb28ba
Jul 15 19:38:38.819283 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.819245    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:38.910067 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.909983    2580 apiserver.go:52] "Watching apiserver"
Jul 15 19:38:38.917836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.917816    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 19:38:38.918203 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.918177    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-nr2kc","openshift-multus/multus-tghfh","openshift-multus/network-metrics-daemon-wljcs","openshift-network-operator/iptables-alerter-lvccg","kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hmtqz","openshift-image-registry/node-ca-9xg7d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal","openshift-network-diagnostics/network-check-target-ppl2k","openshift-ovn-kubernetes/ovnkube-node-zl76c","kube-system/global-pull-secret-syncer-wcssg","kube-system/konnectivity-agent-mmttc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z","openshift-dns/node-resolver-r9zm6"]
Jul 15 19:38:38.919883 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.919863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:38.921324 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.921298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:38.921462 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.921436    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:38.922376 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.922361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:38.922453 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.922417    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:38.922585 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.922544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.922585 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.922574    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.922768 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.922589    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 19:38:38.922768 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.922690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8rdb\""
Jul 15 19:38:38.923751 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.923733    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:38.925319 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.925296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:38.926001 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.925983    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.926082 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.926071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 19:38:38.926127 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.926087    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jj9x6\""
Jul 15 19:38:38.926127 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.926072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.926580 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.926561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.927440 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.927419    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.927797 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.927781    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8vx9q\""
Jul 15 19:38:38.927939 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.927923    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:38.928036 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:38.927991    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:38.928158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.928146    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.928834 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.928816    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.929140 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.929124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k26sg\""
Jul 15 19:38:38.929265 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.929249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.930007 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.929876    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.931726 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.931652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.932002 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.931980    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.932153 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.932128    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8pvn\""
Jul 15 19:38:38.932663 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.932643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 19:38:38.933361 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.933150    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.933361 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.933254    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 19:38:38.933361 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.933352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.934124 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.934101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 19:38:38.934298 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.934278    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7v2k\""
Jul 15 19:38:38.934401 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.934373    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 19:38:38.934463 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.934441    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.935249 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.935227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.935432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.935414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:38.935864 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.935845    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 19:38:38.936076 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936032    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 19:38:38.936204 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 19:38:38.936530 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936508    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 19:38:38.936653 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936565    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 19:38:38.936721 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936700    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 19:38:38.936782 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.936755    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:38.938014 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.937996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 19:38:38.938014 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.938003    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvsqr\""
Jul 15 19:38:38.938014 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.938013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 19:38:38.938750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.938736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x764r\""
Jul 15 19:38:38.941310 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941291    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 19:38:38.941310 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-socket-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.941421 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.941421 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-cni-binary-copy\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.941421 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941357    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m2vjk\""
Jul 15 19:38:38.941421 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-k8s-cni-cncf-io\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.941421 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-sys-fs\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-daemon-config\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-etc-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzx4\" (UniqueName: \"kubernetes.io/projected/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-kube-api-access-tmzx4\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7csp\" (UniqueName: \"kubernetes.io/projected/70481fc1-2128-4963-91a1-8ec5ce56cfa1-kube-api-access-m7csp\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-systemd\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2nqf\" (UniqueName: \"kubernetes.io/projected/384de95f-bb53-4f83-a514-c8490613b0b6-kube-api-access-q2nqf\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-bin\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.941691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd238eab-7942-486a-a93b-9dbfd178fab6-iptables-alerter-script\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-run\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-os-release\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-systemd-units\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-host\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941900    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-serviceca\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-modprobe-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.941981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-netns\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-var-lib-kubelet\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb46s\" (UniqueName: \"kubernetes.io/projected/ebe7f395-2f34-4812-84ed-96238db36f01-kube-api-access-vb46s\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-dbus\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnnm\" (UniqueName: \"kubernetes.io/projected/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kube-api-access-lfnnm\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-bin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd238eab-7942-486a-a93b-9dbfd178fab6-host-slash\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmcm\" (UniqueName: \"kubernetes.io/projected/fd238eab-7942-486a-a93b-9dbfd178fab6-kube-api-access-6pmcm\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-netns\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-etc-kubernetes\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-log-socket\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-netd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-tmp-dir\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-conf\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-device-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-cnibin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-kubelet\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.942668 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-systemd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-config\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/384de95f-bb53-4f83-a514-c8490613b0b6-ovn-node-metrics-cert\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-sys\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-system-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-multus\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-hosts-file\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-kubernetes\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-lib-modules\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-etc-tuned\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-tmp\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.942962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-multus-certs\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-script-lib\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnrzr\" (UniqueName: \"kubernetes.io/projected/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-kube-api-access-dnrzr\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysconfig\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-registration-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.943206 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-hostroot\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-kubelet\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-env-overrides\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-host\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-conf-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc7ls\" (UniqueName: \"kubernetes.io/projected/c24df6eb-ae5b-4290-9690-d7ae594211ff-kube-api-access-rc7ls\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-slash\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-var-lib-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-ovn\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-kubelet-config\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-socket-dir-parent\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-node-log\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:38.943913 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.943508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:38.944466 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.944447    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:38:38.970131 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.970110    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6hp5"
Jul 15 19:38:38.979647 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:38.979618    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h6hp5"
Jul 15 19:38:39.034048 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.034012    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 19:38:39.043946 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.043923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.043950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-bin\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.043970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.043988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd238eab-7942-486a-a93b-9dbfd178fab6-iptables-alerter-script\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-run\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cnibin\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-os-release\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-bin\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-run\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.044178    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-systemd-units\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-host\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-os-release\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.044248    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:39.544224644 +0000 UTC m=+2.947605280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-host\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-systemd-units\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-serviceca\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-modprobe-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c407be5-be0e-4b3c-8b5e-39ef303ee808-konnectivity-ca\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-netns\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-var-lib-kubelet\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-run-netns\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb46s\" (UniqueName: \"kubernetes.io/projected/ebe7f395-2f34-4812-84ed-96238db36f01-kube-api-access-vb46s\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-var-lib-kubelet\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.044598 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-dbus\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-dbus\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-serviceca\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-modprobe-d\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fd238eab-7942-486a-a93b-9dbfd178fab6-iptables-alerter-script\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.044656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnnm\" (UniqueName: \"kubernetes.io/projected/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kube-api-access-lfnnm\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-bin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd238eab-7942-486a-a93b-9dbfd178fab6-host-slash\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmcm\" (UniqueName: \"kubernetes.io/projected/fd238eab-7942-486a-a93b-9dbfd178fab6-kube-api-access-6pmcm\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.045297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-netns\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-etc-kubernetes\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-log-socket\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045382    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-netd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fd238eab-7942-486a-a93b-9dbfd178fab6-host-slash\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-netns\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-bin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-tmp-dir\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-log-socket\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-cni-netd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-conf\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-device-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-cnibin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-device-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-kubelet\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysctl-conf\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.045750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-systemd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-kubelet\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-cnibin\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-config\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-systemd\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-etc-kubernetes\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.045701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/384de95f-bb53-4f83-a514-c8490613b0b6-ovn-node-metrics-cert\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-sys\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-config\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.046621 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046581    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-sys\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-system-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-multus\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-hosts-file\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-kubernetes\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-lib-modules\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-etc-tuned\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-tmp\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-os-release\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.046988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-multus-certs\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-script-lib\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnrzr\" (UniqueName: \"kubernetes.io/projected/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-kube-api-access-dnrzr\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.047109 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysconfig\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-registration-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047168    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-hostroot\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-kubelet\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-env-overrides\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-host\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c407be5-be0e-4b3c-8b5e-39ef303ee808-agent-certs\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-conf-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7ls\" (UniqueName: \"kubernetes.io/projected/c24df6eb-ae5b-4290-9690-d7ae594211ff-kube-api-access-rc7ls\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-slash\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-var-lib-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-ovn\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-kubelet-config\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-socket-dir-parent\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-node-log\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.047720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-socket-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-cni-binary-copy\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-k8s-cni-cncf-io\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-sys-fs\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.047982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-daemon-config\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-etc-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzx4\" (UniqueName: \"kubernetes.io/projected/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-kube-api-access-tmzx4\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7csp\" (UniqueName: \"kubernetes.io/projected/70481fc1-2128-4963-91a1-8ec5ce56cfa1-kube-api-access-m7csp\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-systemd\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.048498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2nqf\" (UniqueName: \"kubernetes.io/projected/384de95f-bb53-4f83-a514-c8490613b0b6-kube-api-access-q2nqf\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfmkx\" (UniqueName: \"kubernetes.io/projected/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-kube-api-access-sfmkx\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-system-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-var-lib-cni-multus\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-hosts-file\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-kubernetes\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.049257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.048637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-lib-modules\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.049546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-run-ovn\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.049546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-kubelet\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.049546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-sysconfig\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.049546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8575b3d1-81c5-4684-aa18-63ec8d028373-kubelet-config\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.049546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-socket-dir-parent\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.049812 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-tmp-dir\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.049812 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-var-lib-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.049812 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-conf-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.049812 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.049771    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:39.049812 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-multus-certs\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.049845    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:39.54982617 +0000 UTC m=+2.953206789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-hostroot\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-env-overrides\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-node-log\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-cni-dir\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.049990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-etc-openvswitch\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-etc-systemd\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-socket-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-slash\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-sys-fs\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-registration-dir\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c24df6eb-ae5b-4290-9690-d7ae594211ff-host-run-k8s-cni-cncf-io\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/384de95f-bb53-4f83-a514-c8490613b0b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050432 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebe7f395-2f34-4812-84ed-96238db36f01-host\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.050835 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-cni-binary-copy\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050835 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/384de95f-bb53-4f83-a514-c8490613b0b6-ovnkube-script-lib\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.050835 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c24df6eb-ae5b-4290-9690-d7ae594211ff-multus-daemon-config\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.050956 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.050870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/384de95f-bb53-4f83-a514-c8490613b0b6-ovn-node-metrics-cert\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.051599 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.051583    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:39.051649 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.051604    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:39.051649 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.051615    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:39.051754 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.051664    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:39.551651955 +0000 UTC m=+2.955032586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:39.052801 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.052780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-etc-tuned\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.052801 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.052796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebe7f395-2f34-4812-84ed-96238db36f01-tmp\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.055001 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.054976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb46s\" (UniqueName: \"kubernetes.io/projected/ebe7f395-2f34-4812-84ed-96238db36f01-kube-api-access-vb46s\") pod \"tuned-hmtqz\" (UID: \"ebe7f395-2f34-4812-84ed-96238db36f01\") " pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.055118 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.055096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnnm\" (UniqueName: \"kubernetes.io/projected/2a0c84ca-d2e7-4ce2-bbce-775bca2ee926-kube-api-access-lfnnm\") pod \"aws-ebs-csi-driver-node-xrj5z\" (UID: \"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.055642 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.055547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmcm\" (UniqueName: \"kubernetes.io/projected/fd238eab-7942-486a-a93b-9dbfd178fab6-kube-api-access-6pmcm\") pod \"iptables-alerter-lvccg\" (UID: \"fd238eab-7942-486a-a93b-9dbfd178fab6\") " pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.058537 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.058502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnrzr\" (UniqueName: \"kubernetes.io/projected/3c415cac-77c5-4acb-9b85-ddd9c39f7fcf-kube-api-access-dnrzr\") pod \"node-resolver-r9zm6\" (UID: \"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf\") " pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.059999 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.059978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7csp\" (UniqueName: \"kubernetes.io/projected/70481fc1-2128-4963-91a1-8ec5ce56cfa1-kube-api-access-m7csp\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:39.060245 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.060228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2nqf\" (UniqueName: \"kubernetes.io/projected/384de95f-bb53-4f83-a514-c8490613b0b6-kube-api-access-q2nqf\") pod \"ovnkube-node-zl76c\" (UID: \"384de95f-bb53-4f83-a514-c8490613b0b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.060572 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.060533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzx4\" (UniqueName: \"kubernetes.io/projected/7f49c0da-2b9d-43bb-ab8a-5828bb4da058-kube-api-access-tmzx4\") pod \"node-ca-9xg7d\" (UID: \"7f49c0da-2b9d-43bb-ab8a-5828bb4da058\") " pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.060933 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.060913    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7ls\" (UniqueName: \"kubernetes.io/projected/c24df6eb-ae5b-4290-9690-d7ae594211ff-kube-api-access-rc7ls\") pod \"multus-tghfh\" (UID: \"c24df6eb-ae5b-4290-9690-d7ae594211ff\") " pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.116441 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.116392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"c7e403cd9bea9a483eb12fa077866f3f","Type":"ContainerStarted","Data":"a1e2a319421c461239e88bdb8922c71720d0b74fb732e776ff7f2998dabb28ba"}
Jul 15 19:38:39.117511 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.117483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"227c6777e0634aba2eac3313d628eb57","Type":"ContainerStarted","Data":"a020abb24fcb8dfb884d0cbf86412902f42a946471ac23d1312efb5c8977f362"}
Jul 15 19:38:39.149560 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149662 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c407be5-be0e-4b3c-8b5e-39ef303ee808-agent-certs\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.149662 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149662 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfmkx\" (UniqueName: \"kubernetes.io/projected/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-kube-api-access-sfmkx\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.149859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cnibin\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c407be5-be0e-4b3c-8b5e-39ef303ee808-konnectivity-ca\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.149974    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cnibin\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-os-release\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-os-release\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150367 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150367 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150678 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.150678 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.150444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c407be5-be0e-4b3c-8b5e-39ef303ee808-konnectivity-ca\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.152490 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.152464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c407be5-be0e-4b3c-8b5e-39ef303ee808-agent-certs\") pod \"konnectivity-agent-mmttc\" (UID: \"5c407be5-be0e-4b3c-8b5e-39ef303ee808\") " pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.160124 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.160070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfmkx\" (UniqueName: \"kubernetes.io/projected/50736e9d-694f-43c4-82fb-9dfcbbbe2bd5-kube-api-access-sfmkx\") pod \"multus-additional-cni-plugins-nr2kc\" (UID: \"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5\") " pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.231619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.231580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xg7d"
Jul 15 19:38:39.239930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.239903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvccg"
Jul 15 19:38:39.241068 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.241037    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f49c0da_2b9d_43bb_ab8a_5828bb4da058.slice/crio-a9f0ff6d1ba1c505f151db66e769c4fcf75e230c13fb59a4b99159ab15fbb6fe WatchSource:0}: Error finding container a9f0ff6d1ba1c505f151db66e769c4fcf75e230c13fb59a4b99159ab15fbb6fe: Status 404 returned error can't find the container with id a9f0ff6d1ba1c505f151db66e769c4fcf75e230c13fb59a4b99159ab15fbb6fe
Jul 15 19:38:39.247749 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.247726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r9zm6"
Jul 15 19:38:39.249392 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.249367    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd238eab_7942_486a_a93b_9dbfd178fab6.slice/crio-577cd564bc90042858c9a766ac1a088e4a1d438aa4d52eceeed5d6e3d379c145 WatchSource:0}: Error finding container 577cd564bc90042858c9a766ac1a088e4a1d438aa4d52eceeed5d6e3d379c145: Status 404 returned error can't find the container with id 577cd564bc90042858c9a766ac1a088e4a1d438aa4d52eceeed5d6e3d379c145
Jul 15 19:38:39.251449 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.251425    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hmtqz"
Jul 15 19:38:39.257532 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.257509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z"
Jul 15 19:38:39.258805 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.258774    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c415cac_77c5_4acb_9b85_ddd9c39f7fcf.slice/crio-2cde12d39f943b1effde7336cc97064eb6ea4fcaceef4ab8503ae8ca8632c61e WatchSource:0}: Error finding container 2cde12d39f943b1effde7336cc97064eb6ea4fcaceef4ab8503ae8ca8632c61e: Status 404 returned error can't find the container with id 2cde12d39f943b1effde7336cc97064eb6ea4fcaceef4ab8503ae8ca8632c61e
Jul 15 19:38:39.261435 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.261407    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe7f395_2f34_4812_84ed_96238db36f01.slice/crio-4deeccda9ebc4fd97a853917e64ea0640113d3891ce116ab7ff094f92af470d3 WatchSource:0}: Error finding container 4deeccda9ebc4fd97a853917e64ea0640113d3891ce116ab7ff094f92af470d3: Status 404 returned error can't find the container with id 4deeccda9ebc4fd97a853917e64ea0640113d3891ce116ab7ff094f92af470d3
Jul 15 19:38:39.263141 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.263120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tghfh"
Jul 15 19:38:39.269509 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.269485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:38:39.270389 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.270364    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0c84ca_d2e7_4ce2_bbce_775bca2ee926.slice/crio-40c3043cf6eab87b8c313ce3c9acd2fcb5e29342bfc9c0da0af9dbea81531825 WatchSource:0}: Error finding container 40c3043cf6eab87b8c313ce3c9acd2fcb5e29342bfc9c0da0af9dbea81531825: Status 404 returned error can't find the container with id 40c3043cf6eab87b8c313ce3c9acd2fcb5e29342bfc9c0da0af9dbea81531825
Jul 15 19:38:39.273198 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.272982    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24df6eb_ae5b_4290_9690_d7ae594211ff.slice/crio-cdc5e3fa13293eecac34232d88d743b6c5e6e5d8588dbe1347d0f3b1ae619bc1 WatchSource:0}: Error finding container cdc5e3fa13293eecac34232d88d743b6c5e6e5d8588dbe1347d0f3b1ae619bc1: Status 404 returned error can't find the container with id cdc5e3fa13293eecac34232d88d743b6c5e6e5d8588dbe1347d0f3b1ae619bc1
Jul 15 19:38:39.274740 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.274719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nr2kc"
Jul 15 19:38:39.280719 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.279534    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:38:39.287076 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.287039    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50736e9d_694f_43c4_82fb_9dfcbbbe2bd5.slice/crio-42d742c9cff613c3fd2b6cb08d6b8464c5959898b841996c89e6446261495529 WatchSource:0}: Error finding container 42d742c9cff613c3fd2b6cb08d6b8464c5959898b841996c89e6446261495529: Status 404 returned error can't find the container with id 42d742c9cff613c3fd2b6cb08d6b8464c5959898b841996c89e6446261495529
Jul 15 19:38:39.294027 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.293243    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384de95f_bb53_4f83_a514_c8490613b0b6.slice/crio-e4d97e1e6f318b006f6cef16ae03ee6db8aa681ba69c835b040f53b7b3903d74 WatchSource:0}: Error finding container e4d97e1e6f318b006f6cef16ae03ee6db8aa681ba69c835b040f53b7b3903d74: Status 404 returned error can't find the container with id e4d97e1e6f318b006f6cef16ae03ee6db8aa681ba69c835b040f53b7b3903d74
Jul 15 19:38:39.297153 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:38:39.297131    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c407be5_be0e_4b3c_8b5e_39ef303ee808.slice/crio-267d6ed71760e808398624799a055b0bdc64699269bc8a6b8ac559c86f2ce7b2 WatchSource:0}: Error finding container 267d6ed71760e808398624799a055b0bdc64699269bc8a6b8ac559c86f2ce7b2: Status 404 returned error can't find the container with id 267d6ed71760e808398624799a055b0bdc64699269bc8a6b8ac559c86f2ce7b2
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.553898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.553967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.553998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554079    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554129    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554143    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:40.554126296 +0000 UTC m=+3.957506916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554146    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554162    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554187    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:40.554180255 +0000 UTC m=+3.957560875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554206    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:39.554284 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:39.554254    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:40.554238401 +0000 UTC m=+3.957619021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:39.982384 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.982262    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:33:39 +0000 UTC" deadline="2028-04-24 11:07:03.03465715 +0000 UTC"
Jul 15 19:38:39.982384 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:39.982343    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15567h28m23.05231843s"
Jul 15 19:38:40.112727 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.112696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:40.112891 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.112829    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:40.113255 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.113233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:40.113362 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.113331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:40.127205 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.127101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmttc" event={"ID":"5c407be5-be0e-4b3c-8b5e-39ef303ee808","Type":"ContainerStarted","Data":"267d6ed71760e808398624799a055b0bdc64699269bc8a6b8ac559c86f2ce7b2"}
Jul 15 19:38:40.132353 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.132229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerStarted","Data":"42d742c9cff613c3fd2b6cb08d6b8464c5959898b841996c89e6446261495529"}
Jul 15 19:38:40.135018 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.134914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"e4d97e1e6f318b006f6cef16ae03ee6db8aa681ba69c835b040f53b7b3903d74"}
Jul 15 19:38:40.137116 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.136972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z" event={"ID":"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926","Type":"ContainerStarted","Data":"40c3043cf6eab87b8c313ce3c9acd2fcb5e29342bfc9c0da0af9dbea81531825"}
Jul 15 19:38:40.140973 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.140904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvccg" event={"ID":"fd238eab-7942-486a-a93b-9dbfd178fab6","Type":"ContainerStarted","Data":"577cd564bc90042858c9a766ac1a088e4a1d438aa4d52eceeed5d6e3d379c145"}
Jul 15 19:38:40.144383 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.144315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xg7d" event={"ID":"7f49c0da-2b9d-43bb-ab8a-5828bb4da058","Type":"ContainerStarted","Data":"a9f0ff6d1ba1c505f151db66e769c4fcf75e230c13fb59a4b99159ab15fbb6fe"}
Jul 15 19:38:40.147214 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.147141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tghfh" event={"ID":"c24df6eb-ae5b-4290-9690-d7ae594211ff","Type":"ContainerStarted","Data":"cdc5e3fa13293eecac34232d88d743b6c5e6e5d8588dbe1347d0f3b1ae619bc1"}
Jul 15 19:38:40.152583 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.152522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmtqz" event={"ID":"ebe7f395-2f34-4812-84ed-96238db36f01","Type":"ContainerStarted","Data":"4deeccda9ebc4fd97a853917e64ea0640113d3891ce116ab7ff094f92af470d3"}
Jul 15 19:38:40.155255 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.155196    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r9zm6" event={"ID":"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf","Type":"ContainerStarted","Data":"2cde12d39f943b1effde7336cc97064eb6ea4fcaceef4ab8503ae8ca8632c61e"}
Jul 15 19:38:40.562614 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.562575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:40.562787 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.562637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:40.562787 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.562712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:40.562909 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.562873    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:40.562909 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.562891    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:40.562909 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.562903    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:40.563060 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.562963    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:42.562944743 +0000 UTC m=+5.966325376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:40.563384 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.563367    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:40.563444 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.563422    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:42.563405753 +0000 UTC m=+5.966786390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:40.563535 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.563497    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:40.563589 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:40.563538    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:42.563525859 +0000 UTC m=+5.966906482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:40.983150 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.983042    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:33:39 +0000 UTC" deadline="2028-02-04 07:27:53.475727759 +0000 UTC"
Jul 15 19:38:40.983150 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:40.983094    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13643h49m12.492637695s"
Jul 15 19:38:41.114205 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:41.114173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:41.114383 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:41.114293    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:42.111781 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:42.111748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:42.112310 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.111871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:42.112310 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:42.112224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:42.112389 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.112341    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:42.583770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:42.583824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:42.583899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584034    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584090    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:46.584076116 +0000 UTC m=+9.987456729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584136    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:46.584149809 +0000 UTC m=+9.987530423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584205    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584216    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584224    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:42.585919 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:42.584246    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:46.584239821 +0000 UTC m=+9.987620449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:43.112031 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:43.111997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:43.112452 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:43.112123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:44.112503 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:44.112119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:44.112503 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:44.112164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:44.112503 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:44.112271    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:44.112503 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:44.112394    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:45.112513 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:45.112462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:45.113056 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:45.112614    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:46.112573 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:46.112536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:46.113033 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:46.112537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:46.113033 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.112677    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:46.113033 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.112750    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:46.617300 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:46.617257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:46.617513 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:46.617312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:46.617513 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:46.617381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:46.617513 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617439    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:46.617513 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617508    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617537    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:54.617513799 +0000 UTC m=+18.020894428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617559    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:54.617547996 +0000 UTC m=+18.020928613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617604    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617615    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617625    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:46.617725 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:46.617654    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:54.617641704 +0000 UTC m=+18.021022318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:47.113148 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:47.112431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:47.113148 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:47.112778    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:48.111926 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:48.111892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:48.112127 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:48.112021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:48.112418 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:48.112398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:48.112558 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:48.112532    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:49.111990 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:49.111958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:49.112506 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:49.112095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:50.111784 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:50.111753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:50.111977 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:50.111880    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:50.111977 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:50.111950    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:50.112339 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:50.112076    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:51.112572 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:51.112532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:51.112983 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:51.112676    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:52.111738 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:52.111706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:52.111738 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:52.111745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:52.112000 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:52.111831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:52.112000 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:52.111957    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:53.112276 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:53.112239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:53.112740 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:53.112373    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:54.111690 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:54.111651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:54.111918 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.111788    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:54.111918 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:54.111842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:54.112032 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.111962    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:54.679628 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:54.679605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:54.679642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:54.679662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679767    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679776    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679795    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679767    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679803    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679834    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:10.67981389 +0000 UTC m=+34.083194524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679851    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:10.679844562 +0000 UTC m=+34.083225176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:54.679893 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:54.679861    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:10.679855396 +0000 UTC m=+34.083236015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:55.112593 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:55.112553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:55.112772 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:55.112690    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:56.111964 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:56.111931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:56.112397 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:56.111979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:56.112397 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:56.112063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:56.112397 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:56.112193    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:57.112306 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:57.112266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:57.112808 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:57.112383    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:58.111670 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:58.111630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:38:58.111860 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:58.111677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:38:58.111860 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:58.111779    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:38:58.111983 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:58.111919    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:38:59.111977 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.111801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:38:59.112366 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:38:59.112064    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:38:59.200405 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.200379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:38:59.200869 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.200816    2580 generic.go:356] "Generic (PLEG): container finished" podID="384de95f-bb53-4f83-a514-c8490613b0b6" containerID="3857b676b35f3ad56077c702a2e8bab7c1fc8b26350a12de47b4cddc48448c07" exitCode=1
Jul 15 19:38:59.200966 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.200906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"b51e36d626503b1647e297f57d3d793dd915003a329a5be3a046304d5031ff74"}
Jul 15 19:38:59.201018 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.200985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"16bd5359c687cbccdde3fedc4fb5fbf169c3ac311863817765e94b9ec7c707e3"}
Jul 15 19:38:59.201056 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.201036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerDied","Data":"3857b676b35f3ad56077c702a2e8bab7c1fc8b26350a12de47b4cddc48448c07"}
Jul 15 19:38:59.201180 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.201086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"4d55a883b4ac1664f18d7464e0135e0781f6424cb85b77d45ea6c4812d427090"}
Jul 15 19:38:59.203441 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.203411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tghfh" event={"ID":"c24df6eb-ae5b-4290-9690-d7ae594211ff","Type":"ContainerStarted","Data":"1df18b485d6e0d6567fdae45bec56391f8b6326d40f399c7c391a36baed242d3"}
Jul 15 19:38:59.206701 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.206616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hmtqz" event={"ID":"ebe7f395-2f34-4812-84ed-96238db36f01","Type":"ContainerStarted","Data":"baffbf56726d667dbb2a30d0d791cdf3d98d9b3361f7c943ae7401ba578ce04b"}
Jul 15 19:38:59.208433 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.208262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" event={"ID":"c7e403cd9bea9a483eb12fa077866f3f","Type":"ContainerStarted","Data":"8977ea7964994ec82e49eb83940f2a48a3803992c1eab24b47dfe78fb1ba12e0"}
Jul 15 19:38:59.227581 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.227528    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tghfh" podStartSLOduration=2.644640927 podStartE2EDuration="22.227506708s" totalImagesPullingTime="19.582865781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:59.225667358 +0000 UTC m=+22.629047995" watchObservedRunningTime="2026-07-15 19:38:59.227506708 +0000 UTC m=+22.630887334"
Jul 15 19:38:59.241837 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:38:59.241550    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-1.ec2.internal" podStartSLOduration=21.241528952 podStartE2EDuration="21.241528952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:59.241201988 +0000 UTC m=+22.644582625" watchObservedRunningTime="2026-07-15 19:38:59.241528952 +0000 UTC m=+22.644909591"
Jul 15 19:39:00.112700 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.112524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:00.113318 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.112546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:00.113318 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:00.112801    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:00.113318 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:00.112841    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:00.212102 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.212068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r9zm6" event={"ID":"3c415cac-77c5-4acb-9b85-ddd9c39f7fcf","Type":"ContainerStarted","Data":"0ecc03a4d0f6fdcb0fa79fea728992bb0c751a3ae12f946e711b7c6474708a5b"}
Jul 15 19:39:00.213433 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.213401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmttc" event={"ID":"5c407be5-be0e-4b3c-8b5e-39ef303ee808","Type":"ContainerStarted","Data":"e7e43376cd267005a6fa9821fe581e93f258c98113f2b3948286495abe309ca2"}
Jul 15 19:39:00.214838 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.214814    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="6fe4ff5e7efe8e6308a15c4ecf5d3f405dd020c5a9cddf43a3e59ce97024e8cd" exitCode=0
Jul 15 19:39:00.214962 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.214901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"6fe4ff5e7efe8e6308a15c4ecf5d3f405dd020c5a9cddf43a3e59ce97024e8cd"}
Jul 15 19:39:00.217535 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.217518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:39:00.217917 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.217883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"cb4d2d072b736095046b89dbd19c0446f5e1f4083f40f05fe568abc50c07af70"}
Jul 15 19:39:00.218011 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.217943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"39c7dab4f10e15e76b8c311fa979cb125790498dc119c644e500ce6b173b3b71"}
Jul 15 19:39:00.219303 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.219285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z" event={"ID":"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926","Type":"ContainerStarted","Data":"6230f8c8c8fa54b56f70e64dc494075567e8857e010e06274fb60d504dc69d46"}
Jul 15 19:39:00.220463 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.220437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvccg" event={"ID":"fd238eab-7942-486a-a93b-9dbfd178fab6","Type":"ContainerStarted","Data":"5baa30e17683bccbb82df391a7719aadec4ed31f8bbd1a21dc2ab120322d3f5c"}
Jul 15 19:39:00.223228 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.223203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xg7d" event={"ID":"7f49c0da-2b9d-43bb-ab8a-5828bb4da058","Type":"ContainerStarted","Data":"30d76c61f78092d68bec3ccd8f32790c5b6ad90d74a429ea06f815568a9e9cc7"}
Jul 15 19:39:00.224723 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.224700    2580 generic.go:356] "Generic (PLEG): container finished" podID="227c6777e0634aba2eac3313d628eb57" containerID="46b986b8c4d24cd95c3e38a380a1d9fa2149efc63eff9b89591b0f254046b7f2" exitCode=0
Jul 15 19:39:00.224804 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.224745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"227c6777e0634aba2eac3313d628eb57","Type":"ContainerDied","Data":"46b986b8c4d24cd95c3e38a380a1d9fa2149efc63eff9b89591b0f254046b7f2"}
Jul 15 19:39:00.227044 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.227009    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r9zm6" podStartSLOduration=3.916537687 podStartE2EDuration="23.226998457s" totalImagesPullingTime="19.31046077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:00.226609725 +0000 UTC m=+23.629990362" watchObservedRunningTime="2026-07-15 19:39:00.226998457 +0000 UTC m=+23.630379071"
Jul 15 19:39:00.227344 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.227318    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hmtqz" podStartSLOduration=3.889019032 podStartE2EDuration="23.227311376s" totalImagesPullingTime="19.338292344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:59.259816219 +0000 UTC m=+22.663196856" watchObservedRunningTime="2026-07-15 19:39:00.227311376 +0000 UTC m=+23.630692012"
Jul 15 19:39:00.241106 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.241028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lvccg" podStartSLOduration=3.890484115 podStartE2EDuration="23.241013287s" totalImagesPullingTime="19.350529172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:00.240982999 +0000 UTC m=+23.644363634" watchObservedRunningTime="2026-07-15 19:39:00.241013287 +0000 UTC m=+23.644393900"
Jul 15 19:39:00.255844 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.255797    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mmttc" podStartSLOduration=3.952450917 podStartE2EDuration="23.25578268s" totalImagesPullingTime="19.303331763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:00.255393584 +0000 UTC m=+23.658774220" watchObservedRunningTime="2026-07-15 19:39:00.25578268 +0000 UTC m=+23.659163315"
Jul 15 19:39:00.282772 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.282724    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xg7d" podStartSLOduration=3.955300668 podStartE2EDuration="23.282706743s" totalImagesPullingTime="19.327406075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:00.282388601 +0000 UTC m=+23.685769237" watchObservedRunningTime="2026-07-15 19:39:00.282706743 +0000 UTC m=+23.686087380"
Jul 15 19:39:00.568641 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:00.568613    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 19:39:01.004497 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.004364    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:39:00.568633374Z","UUID":"44a5ea6a-df49-4750-bacc-3473058152cb","Handler":null,"Name":"","Endpoint":""}
Jul 15 19:39:01.006363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.006339    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 19:39:01.006523 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.006383    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 19:39:01.112197 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.112166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:01.112378 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:01.112306    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:01.229273 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.229236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" event={"ID":"227c6777e0634aba2eac3313d628eb57","Type":"ContainerStarted","Data":"00c25506727c1102ceaefe1791b3449c576bc564a338aae209c554a8db23ddc9"}
Jul 15 19:39:01.231412 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.231383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z" event={"ID":"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926","Type":"ContainerStarted","Data":"31f64d09ec575c8434591fdc7381aaeec8045f78f0c760f372b5a0d4d604a3b3"}
Jul 15 19:39:01.246714 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.246656    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-1.ec2.internal" podStartSLOduration=23.246636316 podStartE2EDuration="23.246636316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:01.245889924 +0000 UTC m=+24.649270559" watchObservedRunningTime="2026-07-15 19:39:01.246636316 +0000 UTC m=+24.650016957"
Jul 15 19:39:01.440901 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.440815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:39:01.441631 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:01.441609    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:39:02.121554 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:02.121517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:02.121753 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:02.121644    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:02.121753 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:02.121704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:02.121848 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:02.121809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:02.238178 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:02.238155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:39:02.238719 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:02.238625    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"4dc43f12f5fb4e8b66b7bf7b3a5db1003e7c69413e83abf3feaf05de98796bb6"}
Jul 15 19:39:03.112520 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.112471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:03.112718 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:03.112634    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:03.242649 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.242610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z" event={"ID":"2a0c84ca-d2e7-4ce2-bbce-775bca2ee926","Type":"ContainerStarted","Data":"41c9250e62ad8e72d1b781bdb901e3f78dd8579c8b7cc464a41b7788b397a445"}
Jul 15 19:39:03.243139 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.242723    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:39:03.261799 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.261726    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrj5z" podStartSLOduration=7.977734235 podStartE2EDuration="26.26171191s" totalImagesPullingTime="18.283977675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:03.26160812 +0000 UTC m=+26.664988755" watchObservedRunningTime="2026-07-15 19:39:03.26171191 +0000 UTC m=+26.665092546"
Jul 15 19:39:03.442366 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.442274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:39:03.442836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:03.442817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mmttc"
Jul 15 19:39:04.112691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:04.112644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:04.112691 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:04.112676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:04.112921 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:04.112794    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:04.112921 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:04.112906    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:05.111858 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.111826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:05.112560 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:05.111927    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:05.248020 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.247991    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="8b9f61f39274928250ee0662babe0d58ac82361abe0415b62807b254238712e4" exitCode=0
Jul 15 19:39:05.248163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.248085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"8b9f61f39274928250ee0662babe0d58ac82361abe0415b62807b254238712e4"}
Jul 15 19:39:05.251614 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.251592    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:39:05.252053 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.252033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"db1f11ca45e51e4e04a317efdd87b62278faed71ced60df983592c475d5e3410"}
Jul 15 19:39:05.252609 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:05.252588    2580 scope.go:117] "RemoveContainer" containerID="3857b676b35f3ad56077c702a2e8bab7c1fc8b26350a12de47b4cddc48448c07"
Jul 15 19:39:06.112794 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.112608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:06.113181 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.112662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:06.113181 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:06.112886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:06.113181 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:06.112945    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:06.257053 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.257027    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:39:06.257381 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.257359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" event={"ID":"384de95f-bb53-4f83-a514-c8490613b0b6","Type":"ContainerStarted","Data":"cf627fa50173403b1949a2b55ba1d881983e8d0d4b106ed35aa83ffbbb0ae31f"}
Jul 15 19:39:06.257509 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.257460    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:39:06.257769 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.257745    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:06.257859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.257830    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:06.273658 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.273632    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:06.273786 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.273740    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:06.285750 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:06.285704    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" podStartSLOduration=9.934364982 podStartE2EDuration="29.285688824s" totalImagesPullingTime="19.351323842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:06.285040307 +0000 UTC m=+29.688420942" watchObservedRunningTime="2026-07-15 19:39:06.285688824 +0000 UTC m=+29.689069517"
Jul 15 19:39:07.113841 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:07.113271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:07.113841 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:07.113401    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:07.261871 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:07.261838    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="925d20473d649d3a1be089c323e120ff5531a6f81bdf138e26e3facf036d8659" exitCode=0
Jul 15 19:39:07.262007 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:07.261931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"925d20473d649d3a1be089c323e120ff5531a6f81bdf138e26e3facf036d8659"}
Jul 15 19:39:07.262007 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:07.261997    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:39:08.005546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:08.005509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:08.111707 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:08.111679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:08.111794 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:08.111707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:08.111848 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:08.111821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:08.111945 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:08.111919    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:08.266302 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:08.266210    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="2dd2a6a6dd5bad75323539efc1f7b849f2b3a78e25b0680d7df3139ec590ca4a" exitCode=0
Jul 15 19:39:08.266302 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:08.266272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"2dd2a6a6dd5bad75323539efc1f7b849f2b3a78e25b0680d7df3139ec590ca4a"}
Jul 15 19:39:09.111810 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:09.111769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:09.111981 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:09.111920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:09.280628 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:09.280589    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c" podUID="384de95f-bb53-4f83-a514-c8490613b0b6" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 15 19:39:10.112669 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:10.112639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:10.112859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:10.112690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:10.112859 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.112779    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:10.112948 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.112870    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:10.696981 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:10.696947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:10.696991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:10.697052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697114    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697145    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697186    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs podName:70481fc1-2128-4963-91a1-8ec5ce56cfa1 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:42.697169727 +0000 UTC m=+66.100550341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs") pod "network-metrics-daemon-wljcs" (UID: "70481fc1-2128-4963-91a1-8ec5ce56cfa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697200    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret podName:8575b3d1-81c5-4684-aa18-63ec8d028373 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:42.69719396 +0000 UTC m=+66.100574575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret") pod "global-pull-secret-syncer-wcssg" (UID: "8575b3d1-81c5-4684-aa18-63ec8d028373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697200    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697223    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697236    2580 projected.go:196] Error preparing data for projected volume kube-api-access-z5kns for pod openshift-network-diagnostics/network-check-target-ppl2k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:39:10.697422 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:10.697288    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns podName:7dff87df-cd77-458d-8012-3492bcbbc901 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:42.697271565 +0000 UTC m=+66.100652187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z5kns" (UniqueName: "kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns") pod "network-check-target-ppl2k" (UID: "7dff87df-cd77-458d-8012-3492bcbbc901") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:39:11.112003 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:11.111968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:11.112182 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:11.112099    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:12.111891 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:12.111855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:12.112419 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:12.111855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:12.112419 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:12.111999    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:12.112419 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:12.112054    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:13.112393 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:13.112367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:13.112786 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:13.112460    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:13.280514 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:13.280458    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="37f910fa9b6e56b0e6ffe2f2b9f190161b970b6a142c02072c9c368d4abd82f2" exitCode=0
Jul 15 19:39:13.280657 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:13.280509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"37f910fa9b6e56b0e6ffe2f2b9f190161b970b6a142c02072c9c368d4abd82f2"}
Jul 15 19:39:14.112220 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:14.112191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:14.112383 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:14.112291    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:14.112383 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:14.112346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:14.112703 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:14.112425    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:14.285990 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:14.285962    2580 generic.go:356] "Generic (PLEG): container finished" podID="50736e9d-694f-43c4-82fb-9dfcbbbe2bd5" containerID="cd9cb7d421cf344e0a141e29a06c5724bf5863a8c85cfcf8b9617d7a526bbdcb" exitCode=0
Jul 15 19:39:14.286125 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:14.286014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerDied","Data":"cd9cb7d421cf344e0a141e29a06c5724bf5863a8c85cfcf8b9617d7a526bbdcb"}
Jul 15 19:39:15.112022 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:15.111984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:15.112214 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:15.112113    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:15.291271 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:15.291238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" event={"ID":"50736e9d-694f-43c4-82fb-9dfcbbbe2bd5","Type":"ContainerStarted","Data":"43e77742085f2b9f6a098e56c79f97f5eab6355d2e767d190182572fa533279d"}
Jul 15 19:39:15.315574 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:15.315525    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nr2kc" podStartSLOduration=8.300164670000001 podStartE2EDuration="38.315510764s" totalImagesPullingTime="30.015346094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:15.315071885 +0000 UTC m=+38.718452519" watchObservedRunningTime="2026-07-15 19:39:15.315510764 +0000 UTC m=+38.718891399"
Jul 15 19:39:16.111977 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:16.111944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:16.112145 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:16.112060    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:16.112145 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:16.112112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:16.112215 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:16.112201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:17.113161 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:17.113131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:17.113527 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:17.113215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:18.111963 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.111931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:18.112175 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.111931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:18.112175 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:18.112086    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:18.112175 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:18.112147    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:18.343204 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.343170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ppl2k"]
Jul 15 19:39:18.343683 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.343297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:18.343683 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:18.343414    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:18.346056 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.346032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcssg"]
Jul 15 19:39:18.346147 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.346110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:18.346196 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:18.346180    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:18.357931 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.357909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wljcs"]
Jul 15 19:39:18.358015 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:18.357994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:18.358093 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:18.358077    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:20.111933 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:20.111848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:20.112434 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:20.111958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:20.112434 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:20.111970    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:20.112434 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:20.111983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:20.112434 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:20.112069    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:20.112434 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:20.112136    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:22.112453 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.112416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:22.112453 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.112440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:22.112875 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.112544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:22.112875 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:22.112554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wcssg" podUID="8575b3d1-81c5-4684-aa18-63ec8d028373"
Jul 15 19:39:22.112875 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:22.112599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppl2k" podUID="7dff87df-cd77-458d-8012-3492bcbbc901"
Jul 15 19:39:22.112875 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:22.112671    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wljcs" podUID="70481fc1-2128-4963-91a1-8ec5ce56cfa1"
Jul 15 19:39:22.422505 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.422467    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-1.ec2.internal" event="NodeReady"
Jul 15 19:39:22.422637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.422624    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 19:39:22.492363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.492331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dqplb"]
Jul 15 19:39:22.506293 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.506271    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rpmtv"]
Jul 15 19:39:22.506431 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.506413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.511435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.511307    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 19:39:22.512207 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.512186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hjcsl\""
Jul 15 19:39:22.512329 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.512245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 19:39:22.514310 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.514163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 19:39:22.514310 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.514188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 19:39:22.516438 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.516419    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rpmtv"]
Jul 15 19:39:22.516564 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.516457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dqplb"]
Jul 15 19:39:22.516564 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.516559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.520891 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.520876    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 19:39:22.521042 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.520911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 19:39:22.521828 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.521650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t8bxm\""
Jul 15 19:39:22.521828 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.521650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 19:39:22.586566 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.586546    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-st5nh"]
Jul 15 19:39:22.608537 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.608518    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st5nh"]
Jul 15 19:39:22.608635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.608540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.611533 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.611515    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 19:39:22.612661 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.612647    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fvq2\""
Jul 15 19:39:22.612661 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.612654    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 19:39:22.689386 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-data-volume\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.689386 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvxmg\" (UniqueName: \"kubernetes.io/projected/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-kube-api-access-hvxmg\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.689386 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.689618 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-cert\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.689618 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.689618 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b69t5\" (UniqueName: \"kubernetes.io/projected/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-api-access-b69t5\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.689739 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.689633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-crio-socket\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790660 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-crio-socket\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-data-volume\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b082089c-3842-4491-9dbf-0711c896d3b3-config-volume\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.790821 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvxmg\" (UniqueName: \"kubernetes.io/projected/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-kube-api-access-hvxmg\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.790821 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790821 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-cert\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.790959 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b082089c-3842-4491-9dbf-0711c896d3b3-tmp-dir\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.790959 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790959 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-crio-socket\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.790959 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b082089c-3842-4491-9dbf-0711c896d3b3-metrics-tls\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.791158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.790958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b69t5\" (UniqueName: \"kubernetes.io/projected/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-api-access-b69t5\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.791158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.791006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4drq\" (UniqueName: \"kubernetes.io/projected/b082089c-3842-4491-9dbf-0711c896d3b3-kube-api-access-h4drq\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.791158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.791028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-data-volume\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.791471 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.791445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.794876 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.794855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-cert\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.794876 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.794858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.801960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.801938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvxmg\" (UniqueName: \"kubernetes.io/projected/43f3af47-1ef6-4bf4-8aed-d5ef340aaae4-kube-api-access-hvxmg\") pod \"ingress-canary-rpmtv\" (UID: \"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4\") " pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.802159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.802143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b69t5\" (UniqueName: \"kubernetes.io/projected/df44623e-f1ba-4cd4-ab66-64a15dbc75c7-kube-api-access-b69t5\") pod \"insights-runtime-extractor-dqplb\" (UID: \"df44623e-f1ba-4cd4-ab66-64a15dbc75c7\") " pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.817106 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.817090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dqplb"
Jul 15 19:39:22.824196 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.824183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rpmtv"
Jul 15 19:39:22.892505 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.892378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b082089c-3842-4491-9dbf-0711c896d3b3-tmp-dir\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.892505 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.892423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b082089c-3842-4491-9dbf-0711c896d3b3-metrics-tls\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.892636 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.892534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4drq\" (UniqueName: \"kubernetes.io/projected/b082089c-3842-4491-9dbf-0711c896d3b3-kube-api-access-h4drq\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.892636 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.892590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b082089c-3842-4491-9dbf-0711c896d3b3-config-volume\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.893210 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.893188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b082089c-3842-4491-9dbf-0711c896d3b3-config-volume\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.893456 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.893439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b082089c-3842-4491-9dbf-0711c896d3b3-tmp-dir\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.895851 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.895830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b082089c-3842-4491-9dbf-0711c896d3b3-metrics-tls\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.904634 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.904588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4drq\" (UniqueName: \"kubernetes.io/projected/b082089c-3842-4491-9dbf-0711c896d3b3-kube-api-access-h4drq\") pod \"dns-default-st5nh\" (UID: \"b082089c-3842-4491-9dbf-0711c896d3b3\") " pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:22.916581 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:22.916559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:23.047348 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.047126    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rpmtv"]
Jul 15 19:39:23.049781 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.049757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dqplb"]
Jul 15 19:39:23.050752 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:23.050725    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f3af47_1ef6_4bf4_8aed_d5ef340aaae4.slice/crio-c5e35dd5069e579f21f75575c9373618787b8ece91c9342b715e24ff1a096644 WatchSource:0}: Error finding container c5e35dd5069e579f21f75575c9373618787b8ece91c9342b715e24ff1a096644: Status 404 returned error can't find the container with id c5e35dd5069e579f21f75575c9373618787b8ece91c9342b715e24ff1a096644
Jul 15 19:39:23.091595 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:23.091568    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb082089c_3842_4491_9dbf_0711c896d3b3.slice/crio-fa6382a4bf4d12fbfd4d42caf65ae503871e38c52339f5a2fb019f527fbc0ac0 WatchSource:0}: Error finding container fa6382a4bf4d12fbfd4d42caf65ae503871e38c52339f5a2fb019f527fbc0ac0: Status 404 returned error can't find the container with id fa6382a4bf4d12fbfd4d42caf65ae503871e38c52339f5a2fb019f527fbc0ac0
Jul 15 19:39:23.091976 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.091957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-st5nh"]
Jul 15 19:39:23.308612 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.308578    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st5nh" event={"ID":"b082089c-3842-4491-9dbf-0711c896d3b3","Type":"ContainerStarted","Data":"fa6382a4bf4d12fbfd4d42caf65ae503871e38c52339f5a2fb019f527fbc0ac0"}
Jul 15 19:39:23.309723 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.309698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rpmtv" event={"ID":"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4","Type":"ContainerStarted","Data":"c5e35dd5069e579f21f75575c9373618787b8ece91c9342b715e24ff1a096644"}
Jul 15 19:39:23.310711 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.310692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dqplb" event={"ID":"df44623e-f1ba-4cd4-ab66-64a15dbc75c7","Type":"ContainerStarted","Data":"237c86544ddc79baf81709120568095045ee82f6d7785cf3a6b23c58fd0529ce"}
Jul 15 19:39:23.973179 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.973140    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"]
Jul 15 19:39:23.985972 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.985056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:23.987253 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.987196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"]
Jul 15 19:39:23.987842 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.987819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 19:39:23.988083 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:23.988066    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-trsmq\""
Jul 15 19:39:24.100393 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.100135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c65dc07-4385-409c-b34b-ffdab18a0dd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bgc7l\" (UID: \"8c65dc07-4385-409c-b34b-ffdab18a0dd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:24.112217 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.112180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:24.113841 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.112649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:24.113841 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.113035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.116107    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.116495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.116703    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqmsl\""
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.116901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.117515    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:39:24.118230 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.117756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lw97b\""
Jul 15 19:39:24.202147 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.201226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c65dc07-4385-409c-b34b-ffdab18a0dd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bgc7l\" (UID: \"8c65dc07-4385-409c-b34b-ffdab18a0dd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:24.206449 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.206424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c65dc07-4385-409c-b34b-ffdab18a0dd8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-bgc7l\" (UID: \"8c65dc07-4385-409c-b34b-ffdab18a0dd8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:24.301011 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.300960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:24.526764 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:24.526735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"]
Jul 15 19:39:24.529215 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:24.529186    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c65dc07_4385_409c_b34b_ffdab18a0dd8.slice/crio-af0243a0c8383ed6006a39cfe4616e88a7bbe415ec82d4474d1f0fab440330a0 WatchSource:0}: Error finding container af0243a0c8383ed6006a39cfe4616e88a7bbe415ec82d4474d1f0fab440330a0: Status 404 returned error can't find the container with id af0243a0c8383ed6006a39cfe4616e88a7bbe415ec82d4474d1f0fab440330a0
Jul 15 19:39:25.321916 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:25.321873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l" event={"ID":"8c65dc07-4385-409c-b34b-ffdab18a0dd8","Type":"ContainerStarted","Data":"af0243a0c8383ed6006a39cfe4616e88a7bbe415ec82d4474d1f0fab440330a0"}
Jul 15 19:39:27.070172 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.070129    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:39:27.083088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.083060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.083836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.083807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:39:27.085861 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.085839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 19:39:27.085979 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.085969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 19:39:27.086042 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.085843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 19:39:27.086290 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.086269    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 19:39:27.086461 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.086446    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 19:39:27.086550 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.086271    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 19:39:27.088013 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.087097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9w5w4\""
Jul 15 19:39:27.088013 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.087880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 19:39:27.092358 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.092343    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 19:39:27.129260 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.129225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.129377 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.129278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.129377 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.129302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.129556 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.129371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.129556 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.129448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjx24\" (UniqueName: \"kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.130025 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.130002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.130115 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.130073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230490 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjx24\" (UniqueName: \"kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230652 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230652 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230652 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230652 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230853 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.230853 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.230701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.231620 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.231543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.231620 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.231544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.231620 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.231551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.231620 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.231606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.233934 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.233911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.234048 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.234031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.240186 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.240167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjx24\" (UniqueName: \"kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24\") pod \"console-8668475b6f-vlpjn\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") " pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:27.394647 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:27.394556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:29.529509 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:29.529050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:39:30.343759 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.343720    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st5nh" event={"ID":"b082089c-3842-4491-9dbf-0711c896d3b3","Type":"ContainerStarted","Data":"8be187d620d4ac9d94c9cf4e09c29a38e5a587d95b9b78864492c9a85596c1d0"}
Jul 15 19:39:30.343932 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.343820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-st5nh" event={"ID":"b082089c-3842-4491-9dbf-0711c896d3b3","Type":"ContainerStarted","Data":"4573c4d39ea3982075d2ce0a6b1537457725fff3fdb6684acc5b4624bea79c89"}
Jul 15 19:39:30.343932 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.343871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:30.346101 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.346073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dqplb" event={"ID":"df44623e-f1ba-4cd4-ab66-64a15dbc75c7","Type":"ContainerStarted","Data":"e8b197a41f92865f246e45e06b450b692395e8ff6870b00d52aea1fadc7089a0"}
Jul 15 19:39:30.347911 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.347882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l" event={"ID":"8c65dc07-4385-409c-b34b-ffdab18a0dd8","Type":"ContainerStarted","Data":"66d82d9c7ede61fb09f5a05f11c0464b535759b08946a4a9d868ce0bf3b2c8b6"}
Jul 15 19:39:30.348571 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.348545    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:30.350777 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.350755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8668475b6f-vlpjn" event={"ID":"ad75f91e-5527-47a2-baeb-691c5189441c","Type":"ContainerStarted","Data":"ebb9f5a9bc6aa254c0d5ba34e907b1ac5f7782feca13b3c7621e9aa670fd1f7d"}
Jul 15 19:39:30.353930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.353908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rpmtv" event={"ID":"43f3af47-1ef6-4bf4-8aed-d5ef340aaae4","Type":"ContainerStarted","Data":"603b974c6425f6249e19834858adfb0529c7a3681f6c8149491c527dae4ddbc0"}
Jul 15 19:39:30.355195 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.355179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l"
Jul 15 19:39:30.367212 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.367161    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-st5nh" podStartSLOduration=2.6638322370000003 podStartE2EDuration="8.367142664s" totalImagesPullingTime="5.703310427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:30.363902217 +0000 UTC m=+53.767282855" watchObservedRunningTime="2026-07-15 19:39:30.367142664 +0000 UTC m=+53.770523287"
Jul 15 19:39:30.379608 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.379436    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rpmtv" podStartSLOduration=2.051996428 podStartE2EDuration="8.379419655s" totalImagesPullingTime="6.327423227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:30.379084041 +0000 UTC m=+53.782464679" watchObservedRunningTime="2026-07-15 19:39:30.379419655 +0000 UTC m=+53.782800287"
Jul 15 19:39:30.398964 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:30.398909    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-bgc7l" podStartSLOduration=2.544399088 podStartE2EDuration="7.39889124s" totalImagesPullingTime="4.854492152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:30.397704559 +0000 UTC m=+53.801085193" watchObservedRunningTime="2026-07-15 19:39:30.39889124 +0000 UTC m=+53.802271854"
Jul 15 19:39:31.049295 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.049262    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wt24n"]
Jul 15 19:39:31.051553 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.051524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.055001 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.054977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wb8nq\""
Jul 15 19:39:31.055233 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.055216    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 19:39:31.055447 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.055429    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 19:39:31.055673 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.055655    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 19:39:31.055832 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.055819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 19:39:31.056127 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.056106    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 19:39:31.057918 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.057893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.058019 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.057925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190a6cd5-a30e-4a41-bec2-c5fc700d072f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.058019 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.057945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.058019 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.057962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htgp7\" (UniqueName: \"kubernetes.io/projected/190a6cd5-a30e-4a41-bec2-c5fc700d072f-kube-api-access-htgp7\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.064784 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.064766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wt24n"]
Jul 15 19:39:31.159056 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.159021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.159056 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.159066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htgp7\" (UniqueName: \"kubernetes.io/projected/190a6cd5-a30e-4a41-bec2-c5fc700d072f-kube-api-access-htgp7\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.159303 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.159181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.159303 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.159217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190a6cd5-a30e-4a41-bec2-c5fc700d072f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.159982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.159956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/190a6cd5-a30e-4a41-bec2-c5fc700d072f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.160111 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:31.160018    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 19:39:31.160111 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:31.160088    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls podName:190a6cd5-a30e-4a41-bec2-c5fc700d072f nodeName:}" failed. No retries permitted until 2026-07-15 19:39:31.660070976 +0000 UTC m=+55.063451591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls") pod "prometheus-operator-64785b6675-wt24n" (UID: "190a6cd5-a30e-4a41-bec2-c5fc700d072f") : secret "prometheus-operator-tls" not found
Jul 15 19:39:31.164039 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.164017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.171096 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.171071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htgp7\" (UniqueName: \"kubernetes.io/projected/190a6cd5-a30e-4a41-bec2-c5fc700d072f-kube-api-access-htgp7\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.663702 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.663667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.666631 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.666603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/190a6cd5-a30e-4a41-bec2-c5fc700d072f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wt24n\" (UID: \"190a6cd5-a30e-4a41-bec2-c5fc700d072f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:31.965010 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:31.964911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n"
Jul 15 19:39:35.057544 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:35.057510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wt24n"]
Jul 15 19:39:35.062038 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:35.062008    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190a6cd5_a30e_4a41_bec2_c5fc700d072f.slice/crio-fcddf82182761114ce58b88315bcc72203008a9e0d1aae1b2c86faafd63433cb WatchSource:0}: Error finding container fcddf82182761114ce58b88315bcc72203008a9e0d1aae1b2c86faafd63433cb: Status 404 returned error can't find the container with id fcddf82182761114ce58b88315bcc72203008a9e0d1aae1b2c86faafd63433cb
Jul 15 19:39:35.373671 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:35.373630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8668475b6f-vlpjn" event={"ID":"ad75f91e-5527-47a2-baeb-691c5189441c","Type":"ContainerStarted","Data":"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"}
Jul 15 19:39:35.374829 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:35.374804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n" event={"ID":"190a6cd5-a30e-4a41-bec2-c5fc700d072f","Type":"ContainerStarted","Data":"fcddf82182761114ce58b88315bcc72203008a9e0d1aae1b2c86faafd63433cb"}
Jul 15 19:39:35.376343 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:35.376325    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dqplb" event={"ID":"df44623e-f1ba-4cd4-ab66-64a15dbc75c7","Type":"ContainerStarted","Data":"b4baf25e7e79a48c10a8cfe382d5441d008dac883eaca1c4a8fc3b97ebaad2a6"}
Jul 15 19:39:35.392932 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:35.392895    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8668475b6f-vlpjn" podStartSLOduration=2.9931594710000002 podStartE2EDuration="8.392882657s" totalImagesPullingTime="5.399723186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:35.392619638 +0000 UTC m=+58.796000275" watchObservedRunningTime="2026-07-15 19:39:35.392882657 +0000 UTC m=+58.796263292"
Jul 15 19:39:37.385841 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.385801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n" event={"ID":"190a6cd5-a30e-4a41-bec2-c5fc700d072f","Type":"ContainerStarted","Data":"0be308a094122873032f7346b26b52c1b189b569f13312ecf4dc4f82e36e212c"}
Jul 15 19:39:37.386211 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.385863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n" event={"ID":"190a6cd5-a30e-4a41-bec2-c5fc700d072f","Type":"ContainerStarted","Data":"8c4a671314479f300f0b269706e3269c59e0033d5bef7ecea15462ef61976b2c"}
Jul 15 19:39:37.395047 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.395024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:37.395175 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.395082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:37.401073 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.401052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:37.404798 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:37.404757    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-wt24n" podStartSLOduration=4.740291609 podStartE2EDuration="6.404737907s" totalImagesPullingTime="1.664446298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:37.40358723 +0000 UTC m=+60.806967866" watchObservedRunningTime="2026-07-15 19:39:37.404737907 +0000 UTC m=+60.808118543"
Jul 15 19:39:38.393614 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:38.393577    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:39:39.279456 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.279387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zl76c"
Jul 15 19:39:39.394367 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.394311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dqplb" event={"ID":"df44623e-f1ba-4cd4-ab66-64a15dbc75c7","Type":"ContainerStarted","Data":"cb2aae9f09074407939f2f8e2421e9090f39c83568ed61fbfeae5b52ed159aac"}
Jul 15 19:39:39.420215 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.420157    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dqplb" podStartSLOduration=1.6670845349999999 podStartE2EDuration="17.420143682s" totalImagesPullingTime="15.753059147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:39.419337987 +0000 UTC m=+62.822718614" watchObservedRunningTime="2026-07-15 19:39:39.420143682 +0000 UTC m=+62.823524318"
Jul 15 19:39:39.428163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.428142    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"]
Jul 15 19:39:39.430222 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.430200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lqmxg"]
Jul 15 19:39:39.430438 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.430414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.432381 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.432362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.433207 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.433186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tdzfm\""
Jul 15 19:39:39.433294 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.433193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 19:39:39.434820 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.434802    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 19:39:39.434905 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.434835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 19:39:39.435264 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.435244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 19:39:39.435373 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.435353    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 19:39:39.435458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.435445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjfgc\""
Jul 15 19:39:39.445866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.445841    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-fzknq"]
Jul 15 19:39:39.447863 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.447845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.450346 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.450332    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 19:39:39.450696 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.450683    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 19:39:39.450845 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.450828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t5f2f\""
Jul 15 19:39:39.453105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.453087    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 19:39:39.454886 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.454866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"]
Jul 15 19:39:39.464609 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.464588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-fzknq"]
Jul 15 19:39:39.527107 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-sys\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs7cr\" (UniqueName: \"kubernetes.io/projected/f1360144-95b3-4267-8aae-23276c84206e-kube-api-access-xs7cr\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-wtmp\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-metrics-client-ca\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-tls\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wctfq\" (UniqueName: \"kubernetes.io/projected/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-api-access-wctfq\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.527500 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-root\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsxn\" (UniqueName: \"kubernetes.io/projected/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-kube-api-access-svsxn\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.527752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-textfile\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.527752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.527674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56aadaa1-a6de-4370-b25a-ba300c217b17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.628469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-tls\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.628469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wctfq\" (UniqueName: \"kubernetes.io/projected/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-api-access-wctfq\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-root\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsxn\" (UniqueName: \"kubernetes.io/projected/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-kube-api-access-svsxn\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-textfile\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-root\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56aadaa1-a6de-4370-b25a-ba300c217b17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.628752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-sys\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs7cr\" (UniqueName: \"kubernetes.io/projected/f1360144-95b3-4267-8aae-23276c84206e-kube-api-access-xs7cr\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-wtmp\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-metrics-client-ca\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.628916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-sys\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-wtmp\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/56aadaa1-a6de-4370-b25a-ba300c217b17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.629159 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.629725 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.629725 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.629725 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-textfile\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629968 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629968 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1360144-95b3-4267-8aae-23276c84206e-metrics-client-ca\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.629968 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.629893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.629968 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:39.629924    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 19:39:39.630164 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:39.629993    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls podName:56aadaa1-a6de-4370-b25a-ba300c217b17 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:40.129976736 +0000 UTC m=+63.533357366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-fzknq" (UID: "56aadaa1-a6de-4370-b25a-ba300c217b17") : secret "kube-state-metrics-tls" not found
Jul 15 19:39:39.630367 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.630346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56aadaa1-a6de-4370-b25a-ba300c217b17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.631664 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.631635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.632047 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.632025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1360144-95b3-4267-8aae-23276c84206e-node-exporter-tls\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.632107 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.632071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.632107 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.632069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.632286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.632270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.639260 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.639235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsxn\" (UniqueName: \"kubernetes.io/projected/9b1dbfbe-c3f6-499f-ad2b-af7de41de139-kube-api-access-svsxn\") pod \"openshift-state-metrics-84bd68b896-l78zp\" (UID: \"9b1dbfbe-c3f6-499f-ad2b-af7de41de139\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.639497 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.639453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs7cr\" (UniqueName: \"kubernetes.io/projected/f1360144-95b3-4267-8aae-23276c84206e-kube-api-access-xs7cr\") pod \"node-exporter-lqmxg\" (UID: \"f1360144-95b3-4267-8aae-23276c84206e\") " pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.640030 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.640011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wctfq\" (UniqueName: \"kubernetes.io/projected/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-api-access-wctfq\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:39.740204 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.740168    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"
Jul 15 19:39:39.745805 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.745790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqmxg"
Jul 15 19:39:39.756930 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:39.756897    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1360144_95b3_4267_8aae_23276c84206e.slice/crio-f56ec6d9786b0a6c9f851b5c8979bf374aba0e7a63695f30330d06332d7c9a03 WatchSource:0}: Error finding container f56ec6d9786b0a6c9f851b5c8979bf374aba0e7a63695f30330d06332d7c9a03: Status 404 returned error can't find the container with id f56ec6d9786b0a6c9f851b5c8979bf374aba0e7a63695f30330d06332d7c9a03
Jul 15 19:39:39.867875 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:39.867839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp"]
Jul 15 19:39:39.870664 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:39.870637    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1dbfbe_c3f6_499f_ad2b_af7de41de139.slice/crio-2ea7fe99dc6b0c1db0e371005cf1e27d0bf7c53462f8ce52407691ec6e6d0e4d WatchSource:0}: Error finding container 2ea7fe99dc6b0c1db0e371005cf1e27d0bf7c53462f8ce52407691ec6e6d0e4d: Status 404 returned error can't find the container with id 2ea7fe99dc6b0c1db0e371005cf1e27d0bf7c53462f8ce52407691ec6e6d0e4d
Jul 15 19:39:40.134276 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.134195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:40.134421 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:40.134343    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 19:39:40.134421 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:40.134408    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls podName:56aadaa1-a6de-4370-b25a-ba300c217b17 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:41.134392881 +0000 UTC m=+64.537773511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-fzknq" (UID: "56aadaa1-a6de-4370-b25a-ba300c217b17") : secret "kube-state-metrics-tls" not found
Jul 15 19:39:40.360526 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.360473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-st5nh"
Jul 15 19:39:40.405586 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.402726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp" event={"ID":"9b1dbfbe-c3f6-499f-ad2b-af7de41de139","Type":"ContainerStarted","Data":"283ff939e8c29a77b4eb4e88f04c3c978eecb138cdfcd0454c1e89e8b843ed4d"}
Jul 15 19:39:40.405586 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.402800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp" event={"ID":"9b1dbfbe-c3f6-499f-ad2b-af7de41de139","Type":"ContainerStarted","Data":"8ffad30ef1906288d7b7e143a58813a10f8ac1c3a885b0a9d918a5489992a4f8"}
Jul 15 19:39:40.405586 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.402822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp" event={"ID":"9b1dbfbe-c3f6-499f-ad2b-af7de41de139","Type":"ContainerStarted","Data":"2ea7fe99dc6b0c1db0e371005cf1e27d0bf7c53462f8ce52407691ec6e6d0e4d"}
Jul 15 19:39:40.405586 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:40.403905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqmxg" event={"ID":"f1360144-95b3-4267-8aae-23276c84206e","Type":"ContainerStarted","Data":"f56ec6d9786b0a6c9f851b5c8979bf374aba0e7a63695f30330d06332d7c9a03"}
Jul 15 19:39:41.146185 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.146152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:41.148387 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.148364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56aadaa1-a6de-4370-b25a-ba300c217b17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-fzknq\" (UID: \"56aadaa1-a6de-4370-b25a-ba300c217b17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:41.257158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.257125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq"
Jul 15 19:39:41.388798 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.388766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-fzknq"]
Jul 15 19:39:41.391994 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:41.391964    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56aadaa1_a6de_4370_b25a_ba300c217b17.slice/crio-b5d12ccb0d2bfcc77a15abda59e065d6a482ecd07427eb4aea98ab1a6053a961 WatchSource:0}: Error finding container b5d12ccb0d2bfcc77a15abda59e065d6a482ecd07427eb4aea98ab1a6053a961: Status 404 returned error can't find the container with id b5d12ccb0d2bfcc77a15abda59e065d6a482ecd07427eb4aea98ab1a6053a961
Jul 15 19:39:41.409260 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.409233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp" event={"ID":"9b1dbfbe-c3f6-499f-ad2b-af7de41de139","Type":"ContainerStarted","Data":"3bb1cdcb6bf6e6e89449a946382b59332a6aec48938ce74248855d42b9713a96"}
Jul 15 19:39:41.410453 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.410428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq" event={"ID":"56aadaa1-a6de-4370-b25a-ba300c217b17","Type":"ContainerStarted","Data":"b5d12ccb0d2bfcc77a15abda59e065d6a482ecd07427eb4aea98ab1a6053a961"}
Jul 15 19:39:41.411888 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.411865    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1360144-95b3-4267-8aae-23276c84206e" containerID="26220d319725ed4bbaef076bc939aea1504d0c4798ea20fa96f3f1fc57be2f76" exitCode=0
Jul 15 19:39:41.412002 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.411900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqmxg" event={"ID":"f1360144-95b3-4267-8aae-23276c84206e","Type":"ContainerDied","Data":"26220d319725ed4bbaef076bc939aea1504d0c4798ea20fa96f3f1fc57be2f76"}
Jul 15 19:39:41.428334 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:41.428285    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-l78zp" podStartSLOduration=1.454485689 podStartE2EDuration="2.428263759s" totalImagesPullingTime="973.77807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:41.426156175 +0000 UTC m=+64.829536811" watchObservedRunningTime="2026-07-15 19:39:41.428263759 +0000 UTC m=+64.831644397"
Jul 15 19:39:42.419240 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.419207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqmxg" event={"ID":"f1360144-95b3-4267-8aae-23276c84206e","Type":"ContainerStarted","Data":"f2a818af34b5ea0be6422801b737eca0fe3ca5c18bf5198bc049f2619795d188"}
Jul 15 19:39:42.420288 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.419260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqmxg" event={"ID":"f1360144-95b3-4267-8aae-23276c84206e","Type":"ContainerStarted","Data":"15c3be1256a7fec488ebff781e5f577ae3c4687f594350fad6864a0db7b121b7"}
Jul 15 19:39:42.442706 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.442664    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lqmxg" podStartSLOduration=2.169501507 podStartE2EDuration="3.44264934s" totalImagesPullingTime="1.200647343s" totalInitContainerRuntime="72.50049ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:42.441768257 +0000 UTC m=+65.845148893" watchObservedRunningTime="2026-07-15 19:39:42.44264934 +0000 UTC m=+65.846029975"
Jul 15 19:39:42.760179 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.760145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:42.760334 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.760186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:42.760334 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.760206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:42.762391 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.762369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:39:42.762464 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.762448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:39:42.763048 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.763033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:39:42.773043 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.773012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70481fc1-2128-4963-91a1-8ec5ce56cfa1-metrics-certs\") pod \"network-metrics-daemon-wljcs\" (UID: \"70481fc1-2128-4963-91a1-8ec5ce56cfa1\") " pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:42.773162 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.773146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8575b3d1-81c5-4684-aa18-63ec8d028373-original-pull-secret\") pod \"global-pull-secret-syncer-wcssg\" (UID: \"8575b3d1-81c5-4684-aa18-63ec8d028373\") " pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:42.773203 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.773151    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:39:42.783438 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:42.783415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kns\" (UniqueName: \"kubernetes.io/projected/7dff87df-cd77-458d-8012-3492bcbbc901-kube-api-access-z5kns\") pod \"network-check-target-ppl2k\" (UID: \"7dff87df-cd77-458d-8012-3492bcbbc901\") " pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:43.036710 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.036635    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqmsl\""
Jul 15 19:39:43.045069 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.045037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wljcs"
Jul 15 19:39:43.046591 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.046566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lw97b\""
Jul 15 19:39:43.052915 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.052896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wcssg"
Jul 15 19:39:43.055018 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.054999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:43.309681 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.309655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ppl2k"]
Jul 15 19:39:43.312954 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:43.312919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dff87df_cd77_458d_8012_3492bcbbc901.slice/crio-70e606eaf2d1f9e6c432b07ce0ea92dd5cd4aa9db0bb836e3ac90f333a4bfb32 WatchSource:0}: Error finding container 70e606eaf2d1f9e6c432b07ce0ea92dd5cd4aa9db0bb836e3ac90f333a4bfb32: Status 404 returned error can't find the container with id 70e606eaf2d1f9e6c432b07ce0ea92dd5cd4aa9db0bb836e3ac90f333a4bfb32
Jul 15 19:39:43.423546 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.423508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ppl2k" event={"ID":"7dff87df-cd77-458d-8012-3492bcbbc901","Type":"ContainerStarted","Data":"70e606eaf2d1f9e6c432b07ce0ea92dd5cd4aa9db0bb836e3ac90f333a4bfb32"}
Jul 15 19:39:43.533547 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.533511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wcssg"]
Jul 15 19:39:43.537418 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:43.537064    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8575b3d1_81c5_4684_aa18_63ec8d028373.slice/crio-06807e41624fb1685f17761eeba15a45652740480d6844d1f4a59ffe9dad8fdd WatchSource:0}: Error finding container 06807e41624fb1685f17761eeba15a45652740480d6844d1f4a59ffe9dad8fdd: Status 404 returned error can't find the container with id 06807e41624fb1685f17761eeba15a45652740480d6844d1f4a59ffe9dad8fdd
Jul 15 19:39:43.537418 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.537085    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wljcs"]
Jul 15 19:39:43.540399 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:43.540382    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70481fc1_2128_4963_91a1_8ec5ce56cfa1.slice/crio-fbd444b1f4993d5a2ffe07d06ed75ef82dea645e0ab9ec6cf1beb2062b29df14 WatchSource:0}: Error finding container fbd444b1f4993d5a2ffe07d06ed75ef82dea645e0ab9ec6cf1beb2062b29df14: Status 404 returned error can't find the container with id fbd444b1f4993d5a2ffe07d06ed75ef82dea645e0ab9ec6cf1beb2062b29df14
Jul 15 19:39:43.948606 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.948513    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d69f69757-tplh4"]
Jul 15 19:39:43.951284 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.951008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:43.956808 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.956786    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 19:39:43.957019 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.957004    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dn4s2\""
Jul 15 19:39:43.957567 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.957532    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 19:39:43.957567 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.957552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 19:39:43.957840 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.957826    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 19:39:43.961933 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.961910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dbemdvad8h9j5\""
Jul 15 19:39:43.976543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:43.976444    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d69f69757-tplh4"]
Jul 15 19:39:44.070696 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-metrics-server-audit-profiles\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsz5k\" (UniqueName: \"kubernetes.io/projected/2ca12397-a2cf-429d-bdb5-c81772af9ddb-kube-api-access-bsz5k\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ca12397-a2cf-429d-bdb5-c81772af9ddb-audit-log\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-client-certs\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-tls\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.070927 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.070901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-client-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171436 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-metrics-server-audit-profiles\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsz5k\" (UniqueName: \"kubernetes.io/projected/2ca12397-a2cf-429d-bdb5-c81772af9ddb-kube-api-access-bsz5k\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ca12397-a2cf-429d-bdb5-c81772af9ddb-audit-log\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-client-certs\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-tls\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.171861 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.171642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-client-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.173639 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.172944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ca12397-a2cf-429d-bdb5-c81772af9ddb-audit-log\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.173639 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.173521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.173639 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.173611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ca12397-a2cf-429d-bdb5-c81772af9ddb-metrics-server-audit-profiles\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.175443 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.175417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-tls\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.176550 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.176505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-client-ca-bundle\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.177435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.177412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ca12397-a2cf-429d-bdb5-c81772af9ddb-secret-metrics-server-client-certs\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.204695 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.204614    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:39:44.206632 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.206576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsz5k\" (UniqueName: \"kubernetes.io/projected/2ca12397-a2cf-429d-bdb5-c81772af9ddb-kube-api-access-bsz5k\") pod \"metrics-server-d69f69757-tplh4\" (UID: \"2ca12397-a2cf-429d-bdb5-c81772af9ddb\") " pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.207703 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.207683    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"]
Jul 15 19:39:44.207859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.207836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.209769 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.209751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.212163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.212142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 19:39:44.212760 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.212566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qpjkb\""
Jul 15 19:39:44.221752 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.221724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:39:44.226987 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.226960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"]
Jul 15 19:39:44.264972 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.264934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:39:44.272908 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.272870    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.272917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.272947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prjb\" (UniqueName: \"kubernetes.io/projected/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-kube-api-access-8prjb\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.273059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.272977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.273029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.273059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.273055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.273139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49bh\" (UniqueName: \"kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.273193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.273435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.273242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373812 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49bh\" (UniqueName: \"kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prjb\" (UniqueName: \"kubernetes.io/projected/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-kube-api-access-8prjb\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.373982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.373966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.374271 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.374001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.374271 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.374025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.374608 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:44.374583    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 19:39:44.374684 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:39:44.374661    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert podName:096243ab-f2cc-42d5-bdb3-d2ded14aaa7e nodeName:}" failed. No retries permitted until 2026-07-15 19:39:44.874641415 +0000 UTC m=+68.278022035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-lg7kt" (UID: "096243ab-f2cc-42d5-bdb3-d2ded14aaa7e") : secret "monitoring-plugin-cert" not found
Jul 15 19:39:44.375302 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.375257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.375979 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.375941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.376078 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.376033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.376818 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.376734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.377974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.377945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.378780 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.378760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.383952 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.383927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prjb\" (UniqueName: \"kubernetes.io/projected/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-kube-api-access-8prjb\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.384955 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.384933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49bh\" (UniqueName: \"kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh\") pod \"console-77bb858c88-g775j\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") " pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.430039 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.430001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq" event={"ID":"56aadaa1-a6de-4370-b25a-ba300c217b17","Type":"ContainerStarted","Data":"2980f5694cf14d87c715471140a4955ac93b86b825fe0f01ee1faced6024c908"}
Jul 15 19:39:44.430507 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.430075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq" event={"ID":"56aadaa1-a6de-4370-b25a-ba300c217b17","Type":"ContainerStarted","Data":"7caac5235db7aa5cdc8fbcca6de8b2ef1d6b8142b17e805fa36bc770ca8bb37f"}
Jul 15 19:39:44.430507 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.430102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq" event={"ID":"56aadaa1-a6de-4370-b25a-ba300c217b17","Type":"ContainerStarted","Data":"4e019c98e7bc1b93f4a744bebed0f38f567a807fbaecdea8e620ca2ac741d41c"}
Jul 15 19:39:44.432582 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.432550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcssg" event={"ID":"8575b3d1-81c5-4684-aa18-63ec8d028373","Type":"ContainerStarted","Data":"06807e41624fb1685f17761eeba15a45652740480d6844d1f4a59ffe9dad8fdd"}
Jul 15 19:39:44.433845 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.433821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wljcs" event={"ID":"70481fc1-2128-4963-91a1-8ec5ce56cfa1","Type":"ContainerStarted","Data":"fbd444b1f4993d5a2ffe07d06ed75ef82dea645e0ab9ec6cf1beb2062b29df14"}
Jul 15 19:39:44.450275 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.450216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-fzknq" podStartSLOduration=3.304946896 podStartE2EDuration="5.450193175s" totalImagesPullingTime="2.145246279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:44.449362992 +0000 UTC m=+67.852743656" watchObservedRunningTime="2026-07-15 19:39:44.450193175 +0000 UTC m=+67.853573813"
Jul 15 19:39:44.532097 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.531902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:44.736516 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.735961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:39:44.738835 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:44.738802    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273bd735_419d_41b0_925d_8957eee2600e.slice/crio-dfdefbfb0ad7db9103c9ca3188e6a91aac8071ebfb6621fae47f7a82c364dd9f WatchSource:0}: Error finding container dfdefbfb0ad7db9103c9ca3188e6a91aac8071ebfb6621fae47f7a82c364dd9f: Status 404 returned error can't find the container with id dfdefbfb0ad7db9103c9ca3188e6a91aac8071ebfb6621fae47f7a82c364dd9f
Jul 15 19:39:44.757510 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.757464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d69f69757-tplh4"]
Jul 15 19:39:44.759943 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:44.759911    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca12397_a2cf_429d_bdb5_c81772af9ddb.slice/crio-dd965c290bc25789a28340d7f1566651829031ddcc0bdbf70c8b40c072364852 WatchSource:0}: Error finding container dd965c290bc25789a28340d7f1566651829031ddcc0bdbf70c8b40c072364852: Status 404 returned error can't find the container with id dd965c290bc25789a28340d7f1566651829031ddcc0bdbf70c8b40c072364852
Jul 15 19:39:44.881390 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.880877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:44.884157 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:44.884128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/096243ab-f2cc-42d5-bdb3-d2ded14aaa7e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lg7kt\" (UID: \"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:45.141986 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.141647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:45.304751 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.304464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"]
Jul 15 19:39:45.307462 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:45.307424    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096243ab_f2cc_42d5_bdb3_d2ded14aaa7e.slice/crio-985714d51f78527d2d1a2ddccf86e14594868fc2722f5de58cbd2f29f2645178 WatchSource:0}: Error finding container 985714d51f78527d2d1a2ddccf86e14594868fc2722f5de58cbd2f29f2645178: Status 404 returned error can't find the container with id 985714d51f78527d2d1a2ddccf86e14594868fc2722f5de58cbd2f29f2645178
Jul 15 19:39:45.443253 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.443161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d69f69757-tplh4" event={"ID":"2ca12397-a2cf-429d-bdb5-c81772af9ddb","Type":"ContainerStarted","Data":"dd965c290bc25789a28340d7f1566651829031ddcc0bdbf70c8b40c072364852"}
Jul 15 19:39:45.445526 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.445471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wljcs" event={"ID":"70481fc1-2128-4963-91a1-8ec5ce56cfa1","Type":"ContainerStarted","Data":"599db1a8c55e74a196c8f1a3d4950c538c1cd4215c791aa3f0fd944aa4614677"}
Jul 15 19:39:45.445647 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.445548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wljcs" event={"ID":"70481fc1-2128-4963-91a1-8ec5ce56cfa1","Type":"ContainerStarted","Data":"3845d6f8ceafe7a4cd4d901dc9743e539c0d1a4e53e68c1b9c715cc02d84b1a1"}
Jul 15 19:39:45.448424 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.448368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt" event={"ID":"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e","Type":"ContainerStarted","Data":"985714d51f78527d2d1a2ddccf86e14594868fc2722f5de58cbd2f29f2645178"}
Jul 15 19:39:45.451594 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.451332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb858c88-g775j" event={"ID":"273bd735-419d-41b0-925d-8957eee2600e","Type":"ContainerStarted","Data":"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"}
Jul 15 19:39:45.451594 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.451387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb858c88-g775j" event={"ID":"273bd735-419d-41b0-925d-8957eee2600e","Type":"ContainerStarted","Data":"dfdefbfb0ad7db9103c9ca3188e6a91aac8071ebfb6621fae47f7a82c364dd9f"}
Jul 15 19:39:45.462637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.462559    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wljcs" podStartSLOduration=67.442567148 podStartE2EDuration="1m8.462445401s" totalImagesPullingTime="1.019878253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:45.462186215 +0000 UTC m=+68.865566854" watchObservedRunningTime="2026-07-15 19:39:45.462445401 +0000 UTC m=+68.865826034"
Jul 15 19:39:45.480126 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.480066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77bb858c88-g775j" podStartSLOduration=1.480043177 podStartE2EDuration="1.480043177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:45.479835885 +0000 UTC m=+68.883216522" watchObservedRunningTime="2026-07-15 19:39:45.480043177 +0000 UTC m=+68.883423796"
Jul 15 19:39:45.717637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.717559    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:39:45.721016 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.720877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.725197 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.725172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 19:39:45.725434 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.725404    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 19:39:45.725730 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.725692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 19:39:45.725845 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.725778    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 19:39:45.726073 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.725967    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-318c1hkq9ql0a\""
Jul 15 19:39:45.726073 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 19:39:45.726073 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 19:39:45.726469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726249    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 19:39:45.726469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 19:39:45.726469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 19:39:45.726469 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726501    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 19:39:45.726774 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 19:39:45.730619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726837    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 19:39:45.730619 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.726975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mp9mc\""
Jul 15 19:39:45.732177 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.732152    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 19:39:45.735967 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.735195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 19:39:45.740837 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.740815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:39:45.787869 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.787869 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p287\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-kube-api-access-2p287\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.787981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788229    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.788472 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.788435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.889988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.890022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.890057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.890079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p287\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-kube-api-access-2p287\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.890164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.890113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.891033 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.890741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.892697 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.891119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.892697 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.892152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.892697 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.892368    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.893914 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.893568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.895356 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.894451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.895356 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.895179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.899051 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.899029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.900873 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.900848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e349c92-7cc8-4868-997b-cccb32e72bf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.901508 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.901441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p287\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-kube-api-access-2p287\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.903420 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.903380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.904061 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.904022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.905926 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.905465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.905926 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.905815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e349c92-7cc8-4868-997b-cccb32e72bf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.905926 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.905844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.906216 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.906197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e349c92-7cc8-4868-997b-cccb32e72bf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.906684 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.906636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.906854 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.906814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.907073 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.906920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.907925 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.907198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:45.910059 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:45.909973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e349c92-7cc8-4868-997b-cccb32e72bf1-config\") pod \"prometheus-k8s-0\" (UID: \"0e349c92-7cc8-4868-997b-cccb32e72bf1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:46.044882 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:46.044844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:39:49.471233 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.469704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt" event={"ID":"096243ab-f2cc-42d5-bdb3-d2ded14aaa7e","Type":"ContainerStarted","Data":"d8cbfc635ee017ef6898e81ca39732bd5dbcad85a50f579e69c0381aa0db2e69"}
Jul 15 19:39:49.471233 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.470060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:49.471630 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.471530    2580 patch_prober.go:28] interesting pod/monitoring-plugin-5f68df7f58-lg7kt container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.16:9443/health\": dial tcp 10.134.0.16:9443: connect: connection refused" start-of-body=
Jul 15 19:39:49.471666 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.471617    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt" podUID="096243ab-f2cc-42d5-bdb3-d2ded14aaa7e" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.134.0.16:9443/health\": dial tcp 10.134.0.16:9443: connect: connection refused"
Jul 15 19:39:49.472376 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.472355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ppl2k" event={"ID":"7dff87df-cd77-458d-8012-3492bcbbc901","Type":"ContainerStarted","Data":"ff7348163314a7d910fce5f2095f04e6a12991b03854efc91e51e288030f03d8"}
Jul 15 19:39:49.472555 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.472537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:39:49.475094 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.475063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d69f69757-tplh4" event={"ID":"2ca12397-a2cf-429d-bdb5-c81772af9ddb","Type":"ContainerStarted","Data":"4607e561dbc41297f4a2c0f70abba0afcd35bf179a2b6abc1221623754ddc85d"}
Jul 15 19:39:49.492158 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.492130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:39:49.492805 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.492767    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt" podStartSLOduration=1.4595236329999999 podStartE2EDuration="5.492754318s" totalImagesPullingTime="4.033230685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:49.490226949 +0000 UTC m=+72.893607585" watchObservedRunningTime="2026-07-15 19:39:49.492754318 +0000 UTC m=+72.896134953"
Jul 15 19:39:49.494081 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:39:49.494058    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e349c92_7cc8_4868_997b_cccb32e72bf1.slice/crio-385d39c071f5d6be572709f3ec7b8152ebf5f420deefa176a737f49fa0ad07b0 WatchSource:0}: Error finding container 385d39c071f5d6be572709f3ec7b8152ebf5f420deefa176a737f49fa0ad07b0: Status 404 returned error can't find the container with id 385d39c071f5d6be572709f3ec7b8152ebf5f420deefa176a737f49fa0ad07b0
Jul 15 19:39:49.515859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.515798    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d69f69757-tplh4" podStartSLOduration=1.954321419 podStartE2EDuration="6.515778856s" totalImagesPullingTime="4.561457437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:49.514860296 +0000 UTC m=+72.918240933" watchObservedRunningTime="2026-07-15 19:39:49.515778856 +0000 UTC m=+72.919159494"
Jul 15 19:39:49.532713 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:49.532583    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ppl2k" podStartSLOduration=66.524218263 podStartE2EDuration="1m12.532567234s" totalImagesPullingTime="6.008348971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:49.530753627 +0000 UTC m=+72.934134262" watchObservedRunningTime="2026-07-15 19:39:49.532567234 +0000 UTC m=+72.935947871"
Jul 15 19:39:50.486955 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:50.486508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wcssg" event={"ID":"8575b3d1-81c5-4684-aa18-63ec8d028373","Type":"ContainerStarted","Data":"ef55b59e5b213aead67f629da28257642fdf02bcb9cbc07f6602bffe9b1648b6"}
Jul 15 19:39:50.488381 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:50.488351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"385d39c071f5d6be572709f3ec7b8152ebf5f420deefa176a737f49fa0ad07b0"}
Jul 15 19:39:50.493519 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:50.493472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lg7kt"
Jul 15 19:39:50.505516 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:50.503357    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wcssg" podStartSLOduration=67.683119101 podStartE2EDuration="1m13.503341083s" totalImagesPullingTime="5.820221982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:50.501708361 +0000 UTC m=+73.905088997" watchObservedRunningTime="2026-07-15 19:39:50.503341083 +0000 UTC m=+73.906721718"
Jul 15 19:39:51.493790 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:51.493758    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e349c92-7cc8-4868-997b-cccb32e72bf1" containerID="961a777cbc5fe52454df29820459520a3373f88b672d0c3f586d250d4babe9af" exitCode=0
Jul 15 19:39:51.494178 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:51.493858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerDied","Data":"961a777cbc5fe52454df29820459520a3373f88b672d0c3f586d250d4babe9af"}
Jul 15 19:39:54.532257 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:54.532220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:54.532695 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:54.532290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:54.538267 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:54.538242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:55.514135 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:55.514103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"d4c21c0ac5e9779589920a3e9c18961f81968176771ab933c3713f9655bd0c60"}
Jul 15 19:39:55.514293 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:55.514175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"66d1a447f0fd25493434ee40630085760106e31f0bbbd32ababcc5a5bdd79f80"}
Jul 15 19:39:55.517967 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:55.517940    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:39:55.565728 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:55.565696    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:39:57.527516 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:57.527463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"a7ec772247340036ea7203db6ed03241ee7bd351ba23a6005f49d9c4917543d6"}
Jul 15 19:39:57.527974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:57.527546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"60e309f1f9f046be9a21732bcb2e3f990159992c0b033f710d8cda2c1fc5c293"}
Jul 15 19:39:57.527974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:57.527573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"75a36f0dd019d21e83c2948ec918123b3a3cc0d0a780c09d95b7c47683bf04c3"}
Jul 15 19:39:57.527974 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:57.527597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e349c92-7cc8-4868-997b-cccb32e72bf1","Type":"ContainerStarted","Data":"e38b601c782c824203ffbb7f7e672524d3080528565642329750ca4625bac6ff"}
Jul 15 19:39:57.558266 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:39:57.558198    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.833951261 podStartE2EDuration="12.558176877s" totalImagesPullingTime="6.701154428s" totalInitContainerRuntime="23.071188ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:57.556039343 +0000 UTC m=+80.959419980" watchObservedRunningTime="2026-07-15 19:39:57.558176877 +0000 UTC m=+80.961557514"
Jul 15 19:40:01.045677 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:01.045625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:40:04.265754 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:04.265718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:40:04.266103 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:04.265782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:40:20.491359 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:20.491326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ppl2k"
Jul 15 19:40:20.586836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:20.586786    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8668475b6f-vlpjn" podUID="ad75f91e-5527-47a2-baeb-691c5189441c" containerName="console" containerID="cri-o://f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29" gracePeriod=15
Jul 15 19:40:21.351559 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.351531    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:40:21.409698 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.409866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjx24\" (UniqueName: \"kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.409866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.409866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409765    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.409866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.409866 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409855    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.410129 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.409895    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert\") pod \"ad75f91e-5527-47a2-baeb-691c5189441c\" (UID: \"ad75f91e-5527-47a2-baeb-691c5189441c\") "
Jul 15 19:40:21.410231 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.410190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:21.410231 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.410211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config" (OuterVolumeSpecName: "console-config") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:21.410341 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.410208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:21.410341 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.410247    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:21.412221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.412199    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:40:21.412342 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.412261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:40:21.412342 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.412261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24" (OuterVolumeSpecName: "kube-api-access-jjx24") pod "ad75f91e-5527-47a2-baeb-691c5189441c" (UID: "ad75f91e-5527-47a2-baeb-691c5189441c"). InnerVolumeSpecName "kube-api-access-jjx24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:40:21.510370 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510339    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-trusted-ca-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510370 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510363    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510370 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510373    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510792 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510383    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad75f91e-5527-47a2-baeb-691c5189441c-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510792 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510392    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjx24\" (UniqueName: \"kubernetes.io/projected/ad75f91e-5527-47a2-baeb-691c5189441c-kube-api-access-jjx24\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510792 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510401    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.510792 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.510409    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad75f91e-5527-47a2-baeb-691c5189441c-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:40:21.625964 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.625880    2580 generic.go:356] "Generic (PLEG): container finished" podID="ad75f91e-5527-47a2-baeb-691c5189441c" containerID="f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29" exitCode=0
Jul 15 19:40:21.625964 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.625930    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8668475b6f-vlpjn"
Jul 15 19:40:21.625964 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.625937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8668475b6f-vlpjn" event={"ID":"ad75f91e-5527-47a2-baeb-691c5189441c","Type":"ContainerDied","Data":"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"}
Jul 15 19:40:21.626213 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.625984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8668475b6f-vlpjn" event={"ID":"ad75f91e-5527-47a2-baeb-691c5189441c","Type":"ContainerDied","Data":"ebb9f5a9bc6aa254c0d5ba34e907b1ac5f7782feca13b3c7621e9aa670fd1f7d"}
Jul 15 19:40:21.626213 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.626006    2580 scope.go:117] "RemoveContainer" containerID="f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"
Jul 15 19:40:21.634744 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.634727    2580 scope.go:117] "RemoveContainer" containerID="f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"
Jul 15 19:40:21.635004 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:40:21.634987    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29\": container with ID starting with f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29 not found: ID does not exist" containerID="f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"
Jul 15 19:40:21.635062 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.635013    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29"} err="failed to get container status \"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29\": rpc error: code = NotFound desc = could not find container \"f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29\": container with ID starting with f743f3a4a4838889d5a22f11f3c1adba35222f2eb5e640da010bcb917a6edd29 not found: ID does not exist"
Jul 15 19:40:21.646072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.646046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:40:21.650303 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:21.650286    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8668475b6f-vlpjn"]
Jul 15 19:40:23.116990 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:23.116958    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad75f91e-5527-47a2-baeb-691c5189441c" path="/var/lib/kubelet/pods/ad75f91e-5527-47a2-baeb-691c5189441c/volumes"
Jul 15 19:40:24.271179 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:24.271151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:40:24.275053 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:24.275031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d69f69757-tplh4"
Jul 15 19:40:46.046271 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:46.046228    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:40:46.066176 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:46.066150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:40:46.732077 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:40:46.732052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:41:18.159648 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:18.159618    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:41:43.179791 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.179734    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77bb858c88-g775j" podUID="273bd735-419d-41b0-925d-8957eee2600e" containerName="console" containerID="cri-o://6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584" gracePeriod=15
Jul 15 19:41:43.420637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.420611    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:41:43.577323 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577323 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49bh\" (UniqueName: \"kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577362    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577396    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577635 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert\") pod \"273bd735-419d-41b0-925d-8957eee2600e\" (UID: \"273bd735-419d-41b0-925d-8957eee2600e\") "
Jul 15 19:41:43.577871 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577782    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config" (OuterVolumeSpecName: "console-config") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:43.577871 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577814    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca" (OuterVolumeSpecName: "service-ca") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:43.577871 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.577854    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:43.578061 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.578039    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-console-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.578131 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.578065    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.578131 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.578068    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:43.578131 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.578081    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-trusted-ca-bundle\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.579808 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.579783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh" (OuterVolumeSpecName: "kube-api-access-k49bh") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "kube-api-access-k49bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:41:43.579915 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.579869    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:41:43.579952 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.579926    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "273bd735-419d-41b0-925d-8957eee2600e" (UID: "273bd735-419d-41b0-925d-8957eee2600e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:41:43.679195 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.679154    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-oauth-config\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.679195 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.679189    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/273bd735-419d-41b0-925d-8957eee2600e-oauth-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.679195 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.679198    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49bh\" (UniqueName: \"kubernetes.io/projected/273bd735-419d-41b0-925d-8957eee2600e-kube-api-access-k49bh\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.679195 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.679206    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/273bd735-419d-41b0-925d-8957eee2600e-console-serving-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:41:43.917231 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.917146    2580 generic.go:356] "Generic (PLEG): container finished" podID="273bd735-419d-41b0-925d-8957eee2600e" containerID="6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584" exitCode=0
Jul 15 19:41:43.917231 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.917189    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77bb858c88-g775j"
Jul 15 19:41:43.917231 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.917217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb858c88-g775j" event={"ID":"273bd735-419d-41b0-925d-8957eee2600e","Type":"ContainerDied","Data":"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"}
Jul 15 19:41:43.917440 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.917257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77bb858c88-g775j" event={"ID":"273bd735-419d-41b0-925d-8957eee2600e","Type":"ContainerDied","Data":"dfdefbfb0ad7db9103c9ca3188e6a91aac8071ebfb6621fae47f7a82c364dd9f"}
Jul 15 19:41:43.917440 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.917276    2580 scope.go:117] "RemoveContainer" containerID="6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"
Jul 15 19:41:43.925637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.925621    2580 scope.go:117] "RemoveContainer" containerID="6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"
Jul 15 19:41:43.925878 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:41:43.925861    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584\": container with ID starting with 6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584 not found: ID does not exist" containerID="6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"
Jul 15 19:41:43.925923 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.925887    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584"} err="failed to get container status \"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584\": rpc error: code = NotFound desc = could not find container \"6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584\": container with ID starting with 6c4749bb05a5a5e938374558180fcd56c62a368db5710d0b7b14e3b0fc021584 not found: ID does not exist"
Jul 15 19:41:43.947347 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.947322    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:41:43.949426 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:43.949407    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77bb858c88-g775j"]
Jul 15 19:41:45.116946 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:41:45.116913    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273bd735-419d-41b0-925d-8957eee2600e" path="/var/lib/kubelet/pods/273bd735-419d-41b0-925d-8957eee2600e/volumes"
Jul 15 19:43:36.946657 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:43:36.946627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:43:36.952147 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:43:36.952127    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 19:43:36.952285 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:43:36.952190    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:44:13.778033 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.777989    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"]
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778308    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273bd735-419d-41b0-925d-8957eee2600e" containerName="console"
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778321    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="273bd735-419d-41b0-925d-8957eee2600e" containerName="console"
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778332    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad75f91e-5527-47a2-baeb-691c5189441c" containerName="console"
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778337    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad75f91e-5527-47a2-baeb-691c5189441c" containerName="console"
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778398    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad75f91e-5527-47a2-baeb-691c5189441c" containerName="console"
Jul 15 19:44:13.778543 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.778406    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="273bd735-419d-41b0-925d-8957eee2600e" containerName="console"
Jul 15 19:44:13.780255 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.780237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.782828 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.782804    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 19:44:13.783029 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.783016    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lkq5m\""
Jul 15 19:44:13.784694 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.784680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 19:44:13.793906 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.793887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"]
Jul 15 19:44:13.826193 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.826166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx88q\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-kube-api-access-qx88q\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.826307 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.826197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.927435 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.927409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx88q\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-kube-api-access-qx88q\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.927600 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.927440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.936537 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.936513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:13.936629 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:13.936567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx88q\" (UniqueName: \"kubernetes.io/projected/79150c80-11d0-4854-a75b-fbcdaf1c80b8-kube-api-access-qx88q\") pod \"cert-manager-cainjector-559cdd8c87-9m82b\" (UID: \"79150c80-11d0-4854-a75b-fbcdaf1c80b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:14.101939 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:14.101878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"
Jul 15 19:44:14.227063 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:14.227030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9m82b"]
Jul 15 19:44:14.230836 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:44:14.230812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79150c80_11d0_4854_a75b_fbcdaf1c80b8.slice/crio-8d36b7ced1f4d1d8676cb0940f8ad84b8f42d17a32d504558969d16a8d1dbb85 WatchSource:0}: Error finding container 8d36b7ced1f4d1d8676cb0940f8ad84b8f42d17a32d504558969d16a8d1dbb85: Status 404 returned error can't find the container with id 8d36b7ced1f4d1d8676cb0940f8ad84b8f42d17a32d504558969d16a8d1dbb85
Jul 15 19:44:14.233119 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:14.233101    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:44:14.438066 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:14.437990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b" event={"ID":"79150c80-11d0-4854-a75b-fbcdaf1c80b8","Type":"ContainerStarted","Data":"8d36b7ced1f4d1d8676cb0940f8ad84b8f42d17a32d504558969d16a8d1dbb85"}
Jul 15 19:44:17.451001 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:17.450925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b" event={"ID":"79150c80-11d0-4854-a75b-fbcdaf1c80b8","Type":"ContainerStarted","Data":"1b0b61c4f82eade2f824ebf695ad64c0674aa23fe1650f9edcdb6cda8bc95773"}
Jul 15 19:44:17.468418 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:17.468372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9m82b" podStartSLOduration=1.676564325 podStartE2EDuration="4.468339834s" totalImagesPullingTime="2.791775509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:17.467670945 +0000 UTC m=+340.871051582" watchObservedRunningTime="2026-07-15 19:44:17.468339834 +0000 UTC m=+340.871720470"
Jul 15 19:44:22.435105 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.435078    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-26pxl"]
Jul 15 19:44:22.437155 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.437139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.439451 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.439428    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9tf9w\""
Jul 15 19:44:22.448588 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.448566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-26pxl"]
Jul 15 19:44:22.497688 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.497654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-bound-sa-token\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.497833 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.497714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjqc\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-kube-api-access-8bjqc\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.599011 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.598976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjqc\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-kube-api-access-8bjqc\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.599175 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.599050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-bound-sa-token\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.609269 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.609238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-bound-sa-token\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.609427 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.609408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjqc\" (UniqueName: \"kubernetes.io/projected/740c901f-959c-4a33-ac7d-ceaa29a1d780-kube-api-access-8bjqc\") pod \"cert-manager-55b4d954d5-26pxl\" (UID: \"740c901f-959c-4a33-ac7d-ceaa29a1d780\") " pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.746012 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.745977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-26pxl"
Jul 15 19:44:22.891163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:22.891139    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-26pxl"]
Jul 15 19:44:22.893651 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:44:22.893617    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod740c901f_959c_4a33_ac7d_ceaa29a1d780.slice/crio-55008ffc4ec6ae66ac1a49826ee7abf6d2f707382152d1fb95f6d140cc1b2197 WatchSource:0}: Error finding container 55008ffc4ec6ae66ac1a49826ee7abf6d2f707382152d1fb95f6d140cc1b2197: Status 404 returned error can't find the container with id 55008ffc4ec6ae66ac1a49826ee7abf6d2f707382152d1fb95f6d140cc1b2197
Jul 15 19:44:23.475989 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:23.475953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-26pxl" event={"ID":"740c901f-959c-4a33-ac7d-ceaa29a1d780","Type":"ContainerStarted","Data":"bd6b352bcf9a5331ce56cbb363aa77d91f8885205ce3585c55e7138ff9b28a7c"}
Jul 15 19:44:23.476458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:23.475997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-26pxl" event={"ID":"740c901f-959c-4a33-ac7d-ceaa29a1d780","Type":"ContainerStarted","Data":"55008ffc4ec6ae66ac1a49826ee7abf6d2f707382152d1fb95f6d140cc1b2197"}
Jul 15 19:44:23.493390 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:23.493338    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-26pxl" podStartSLOduration=1.493324593 podStartE2EDuration="1.493324593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:23.491867367 +0000 UTC m=+346.895247993" watchObservedRunningTime="2026-07-15 19:44:23.493324593 +0000 UTC m=+346.896705228"
Jul 15 19:44:42.736050 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.736014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"]
Jul 15 19:44:42.739191 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.739175    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.742845 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.742815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 19:44:42.742984 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.742816    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 19:44:42.742984 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.742903    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x7cc7\""
Jul 15 19:44:42.742984 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.742961    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 19:44:42.743283 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.743263    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:44:42.743362 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.743344    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 19:44:42.766608 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.766582    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"]
Jul 15 19:44:42.873732 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.873693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fghcg\" (UniqueName: \"kubernetes.io/projected/2744ccd2-bf67-4729-a59b-4be801dc626b-kube-api-access-fghcg\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.873732 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.873738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-metrics-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.873949 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.873756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.873949 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.873882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2744ccd2-bf67-4729-a59b-4be801dc626b-manager-config\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.975156 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.975123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-metrics-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.975156 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.975156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.975357 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.975297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2744ccd2-bf67-4729-a59b-4be801dc626b-manager-config\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.975412 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.975358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fghcg\" (UniqueName: \"kubernetes.io/projected/2744ccd2-bf67-4729-a59b-4be801dc626b-kube-api-access-fghcg\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.975930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.975909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2744ccd2-bf67-4729-a59b-4be801dc626b-manager-config\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.977725 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.977706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.977817 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.977765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2744ccd2-bf67-4729-a59b-4be801dc626b-metrics-cert\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:42.985235 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:42.985215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fghcg\" (UniqueName: \"kubernetes.io/projected/2744ccd2-bf67-4729-a59b-4be801dc626b-kube-api-access-fghcg\") pod \"lws-controller-manager-7c89ffd76c-n9f5m\" (UID: \"2744ccd2-bf67-4729-a59b-4be801dc626b\") " pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:43.048082 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.048058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:43.193007 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.192983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"]
Jul 15 19:44:43.193134 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:44:43.193045    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2744ccd2_bf67_4729_a59b_4be801dc626b.slice/crio-f7e67a5b0bd4bed22526303e6f10dde027c9b76bd5cdb42b39d2486f9cb6f588 WatchSource:0}: Error finding container f7e67a5b0bd4bed22526303e6f10dde027c9b76bd5cdb42b39d2486f9cb6f588: Status 404 returned error can't find the container with id f7e67a5b0bd4bed22526303e6f10dde027c9b76bd5cdb42b39d2486f9cb6f588
Jul 15 19:44:43.549521 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.549469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m" event={"ID":"2744ccd2-bf67-4729-a59b-4be801dc626b","Type":"ContainerStarted","Data":"f7e67a5b0bd4bed22526303e6f10dde027c9b76bd5cdb42b39d2486f9cb6f588"}
Jul 15 19:44:43.814994 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.814920    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"]
Jul 15 19:44:43.819579 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.819559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.823518 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.823471    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 19:44:43.823636 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.823580    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 19:44:43.824291 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.824271    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 19:44:43.824368 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.824355    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8svbl\""
Jul 15 19:44:43.826794 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.826778    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 19:44:43.846965 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.846937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"]
Jul 15 19:44:43.883748 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.883711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jw7\" (UniqueName: \"kubernetes.io/projected/041a1982-66f3-4ad8-81ac-0e3af9378712-kube-api-access-s4jw7\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.883906 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.883775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.883906 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.883841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.883975 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.883904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.884012 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.883998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.984896 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.984861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.985057 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.984926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.985057 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.984957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jw7\" (UniqueName: \"kubernetes.io/projected/041a1982-66f3-4ad8-81ac-0e3af9378712-kube-api-access-s4jw7\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.985057 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.984982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.985057 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.985011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.985414 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.985387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.987395 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.987373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041a1982-66f3-4ad8-81ac-0e3af9378712-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.987976 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.987957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.988052 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.987988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/041a1982-66f3-4ad8-81ac-0e3af9378712-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:43.999236 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:43.999206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jw7\" (UniqueName: \"kubernetes.io/projected/041a1982-66f3-4ad8-81ac-0e3af9378712-kube-api-access-s4jw7\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq\" (UID: \"041a1982-66f3-4ad8-81ac-0e3af9378712\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:44.130352 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:44.130254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:44.271547 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:44.271520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"]
Jul 15 19:44:44.275280 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:44:44.275252    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041a1982_66f3_4ad8_81ac_0e3af9378712.slice/crio-82067a0562bd82dce5426fc0067c6aa0d729842d25f4598e26e8ce4d35d70ba5 WatchSource:0}: Error finding container 82067a0562bd82dce5426fc0067c6aa0d729842d25f4598e26e8ce4d35d70ba5: Status 404 returned error can't find the container with id 82067a0562bd82dce5426fc0067c6aa0d729842d25f4598e26e8ce4d35d70ba5
Jul 15 19:44:44.554527 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:44.554459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq" event={"ID":"041a1982-66f3-4ad8-81ac-0e3af9378712","Type":"ContainerStarted","Data":"82067a0562bd82dce5426fc0067c6aa0d729842d25f4598e26e8ce4d35d70ba5"}
Jul 15 19:44:47.569383 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:47.569336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq" event={"ID":"041a1982-66f3-4ad8-81ac-0e3af9378712","Type":"ContainerStarted","Data":"96cda8b6b54bccf0eac26e447c0ed7b9d0a441b56a9a1ea4b3f9ebc89c0123d1"}
Jul 15 19:44:48.575470 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:48.575441    2580 generic.go:356] "Generic (PLEG): container finished" podID="041a1982-66f3-4ad8-81ac-0e3af9378712" containerID="96cda8b6b54bccf0eac26e447c0ed7b9d0a441b56a9a1ea4b3f9ebc89c0123d1" exitCode=0
Jul 15 19:44:48.575829 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:48.575521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq" event={"ID":"041a1982-66f3-4ad8-81ac-0e3af9378712","Type":"ContainerDied","Data":"96cda8b6b54bccf0eac26e447c0ed7b9d0a441b56a9a1ea4b3f9ebc89c0123d1"}
Jul 15 19:44:49.581763 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:49.581724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq" event={"ID":"041a1982-66f3-4ad8-81ac-0e3af9378712","Type":"ContainerStarted","Data":"e23f2379b0a9c1f5befac63f51a7469d10f8d1eb214180be1b5129d3049dcb28"}
Jul 15 19:44:49.582220 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:49.581815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:44:49.606259 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:49.606206    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq" podStartSLOduration=2.15405558 podStartE2EDuration="6.606188849s" totalImagesPullingTime="3.375122141s" totalInitContainerRuntime="1.077011128s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:49.604002755 +0000 UTC m=+373.007383391" watchObservedRunningTime="2026-07-15 19:44:49.606188849 +0000 UTC m=+373.009569485"
Jul 15 19:44:57.622734 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:57.622698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m" event={"ID":"2744ccd2-bf67-4729-a59b-4be801dc626b","Type":"ContainerStarted","Data":"1ecb518499abae7d9e6c2f547210cefe535c5583a081ee77f375d83ccc239702"}
Jul 15 19:44:57.623150 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:57.622851    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:44:57.644265 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:44:57.644219    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m" podStartSLOduration=2.044253706 podStartE2EDuration="15.644206893s" totalImagesPullingTime="13.599953187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:57.642973526 +0000 UTC m=+381.046354163" watchObservedRunningTime="2026-07-15 19:44:57.644206893 +0000 UTC m=+381.047587529"
Jul 15 19:45:00.588434 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:00.588407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq"
Jul 15 19:45:08.628986 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.628953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c89ffd76c-n9f5m"
Jul 15 19:45:08.967930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.967846    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"]
Jul 15 19:45:08.971094 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.971073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:08.973458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.973227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7ltqp\""
Jul 15 19:45:08.973458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.973234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 19:45:08.973458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.973352    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 19:45:08.973458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.973371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 19:45:08.973458 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.973434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 19:45:08.984702 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.984678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"]
Jul 15 19:45:08.998852 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.998827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4qf\" (UniqueName: \"kubernetes.io/projected/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-kube-api-access-px4qf\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:08.998993 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.998884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tmp\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:08.998993 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:08.998961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.100426 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.100391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4qf\" (UniqueName: \"kubernetes.io/projected/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-kube-api-access-px4qf\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.100639 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.100448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tmp\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.100639 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.100535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.100756 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:45:09.100668    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 19:45:09.100805 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:45:09.100759    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs podName:a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7 nodeName:}" failed. No retries permitted until 2026-07-15 19:45:09.600735597 +0000 UTC m=+393.004116231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs") pod "kube-auth-proxy-5fd996b5bf-58s7t" (UID: "a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7") : secret "kube-auth-proxy-tls" not found
Jul 15 19:45:09.102905 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.102879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tmp\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.122498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.121104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4qf\" (UniqueName: \"kubernetes.io/projected/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-kube-api-access-px4qf\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.604351 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.604312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.606932 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.606900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-58s7t\" (UID: \"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:09.881282 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:09.881180    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"
Jul 15 19:45:10.022172 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:10.022146    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t"]
Jul 15 19:45:10.024013 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:45:10.023983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ca1e1e_a0e9_4a84_9305_49dad5cb12a7.slice/crio-4eb3fc892e4fd2a23a51c79c513e6d906673e5e6f572760fc6c73732700d4e3a WatchSource:0}: Error finding container 4eb3fc892e4fd2a23a51c79c513e6d906673e5e6f572760fc6c73732700d4e3a: Status 404 returned error can't find the container with id 4eb3fc892e4fd2a23a51c79c513e6d906673e5e6f572760fc6c73732700d4e3a
Jul 15 19:45:10.677467 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:10.677433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t" event={"ID":"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7","Type":"ContainerStarted","Data":"4eb3fc892e4fd2a23a51c79c513e6d906673e5e6f572760fc6c73732700d4e3a"}
Jul 15 19:45:12.688766 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:12.688719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t" event={"ID":"a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7","Type":"ContainerStarted","Data":"df18404520574214374bf701250cc53763a803aa84aa12d3803bc1c00b409972"}
Jul 15 19:45:12.731568 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:12.731518    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-58s7t" podStartSLOduration=2.704412026 podStartE2EDuration="4.731501531s" totalImagesPullingTime="2.027089505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:12.731292755 +0000 UTC m=+396.134673391" watchObservedRunningTime="2026-07-15 19:45:12.731501531 +0000 UTC m=+396.134882164"
Jul 15 19:45:19.879548 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.879518    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"]
Jul 15 19:45:19.887631 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.887611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:19.896374 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.896351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5rq5r\""
Jul 15 19:45:19.896758 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.896743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 19:45:19.909355 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.909323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"]
Jul 15 19:45:19.991933 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.991899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgc9v\" (UniqueName: \"kubernetes.io/projected/09c54d75-bde3-42f7-8b39-680bb03b08ec-kube-api-access-qgc9v\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:19.992118 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:19.991990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09c54d75-bde3-42f7-8b39-680bb03b08ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.092905 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.092866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgc9v\" (UniqueName: \"kubernetes.io/projected/09c54d75-bde3-42f7-8b39-680bb03b08ec-kube-api-access-qgc9v\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.093086 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.092933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09c54d75-bde3-42f7-8b39-680bb03b08ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.095924 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.095901    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/09c54d75-bde3-42f7-8b39-680bb03b08ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.103402 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.103376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgc9v\" (UniqueName: \"kubernetes.io/projected/09c54d75-bde3-42f7-8b39-680bb03b08ec-kube-api-access-qgc9v\") pod \"llmisvc-controller-manager-777c6bd7d5-kx4fl\" (UID: \"09c54d75-bde3-42f7-8b39-680bb03b08ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.203720 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.203650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:20.352873 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:45:20.352840    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod09c54d75_bde3_42f7_8b39_680bb03b08ec.slice/crio-68e924a52a73b8f249bca8accca0673cbf9ff11b5739f2874087f3758bacd89c WatchSource:0}: Error finding container 68e924a52a73b8f249bca8accca0673cbf9ff11b5739f2874087f3758bacd89c: Status 404 returned error can't find the container with id 68e924a52a73b8f249bca8accca0673cbf9ff11b5739f2874087f3758bacd89c
Jul 15 19:45:20.373286 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.373266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"]
Jul 15 19:45:20.722748 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:20.722719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl" event={"ID":"09c54d75-bde3-42f7-8b39-680bb03b08ec","Type":"ContainerStarted","Data":"68e924a52a73b8f249bca8accca0673cbf9ff11b5739f2874087f3758bacd89c"}
Jul 15 19:45:24.743995 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:24.743963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl" event={"ID":"09c54d75-bde3-42f7-8b39-680bb03b08ec","Type":"ContainerStarted","Data":"557081f466d8023d5475da04b760b6eee94b1abc678425e9d1c471da56330493"}
Jul 15 19:45:24.744369 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:24.744034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:45:24.761466 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:24.761424    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl" podStartSLOduration=2.231485861 podStartE2EDuration="5.76140892s" totalImagesPullingTime="3.529923059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:24.76042886 +0000 UTC m=+408.163809497" watchObservedRunningTime="2026-07-15 19:45:24.76140892 +0000 UTC m=+408.164789553"
Jul 15 19:45:55.749985 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:45:55.749954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kx4fl"
Jul 15 19:47:09.578152 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.578119    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:47:09.581277 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.581255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.584687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.584670    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:47:09.584928 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.584915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-442lt\""
Jul 15 19:47:09.585455 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.585443    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:47:09.603587 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.603560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.603706 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.603631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5d7\" (UniqueName: \"kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.613763 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.613740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:47:09.705072 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.705035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.705265 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.705104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5d7\" (UniqueName: \"kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.705443 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.705422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.727123 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.727090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5d7\" (UniqueName: \"kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7\") pod \"kuadrant-operator-controller-manager-86878c769f-xnrnr\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:09.891840 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:09.891754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:10.159744 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:10.159664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:47:10.162803 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:47:10.162775    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949e59b1_8886_4d40_b282_8a1c7c27cbab.slice/crio-701feed47c77327224a25f46319d80b36c05e7f9772a9cca3540a8594b66e9ac WatchSource:0}: Error finding container 701feed47c77327224a25f46319d80b36c05e7f9772a9cca3540a8594b66e9ac: Status 404 returned error can't find the container with id 701feed47c77327224a25f46319d80b36c05e7f9772a9cca3540a8594b66e9ac
Jul 15 19:47:10.185368 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:10.185338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" event={"ID":"949e59b1-8886-4d40-b282-8a1c7c27cbab","Type":"ContainerStarted","Data":"701feed47c77327224a25f46319d80b36c05e7f9772a9cca3540a8594b66e9ac"}
Jul 15 19:47:15.212270 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:15.212235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" event={"ID":"949e59b1-8886-4d40-b282-8a1c7c27cbab","Type":"ContainerStarted","Data":"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"}
Jul 15 19:47:15.212644 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:15.212324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:15.234515 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:15.234440    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" podStartSLOduration=1.897946108 podStartE2EDuration="6.234425988s" totalImagesPullingTime="4.33647988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:15.234332726 +0000 UTC m=+518.637713361" watchObservedRunningTime="2026-07-15 19:47:15.234425988 +0000 UTC m=+518.637806625"
Jul 15 19:47:26.218267 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:26.218237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:47:45.661319 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.661285    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:45.667164 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.667141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:45.671565 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.671543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-78smg\""
Jul 15 19:47:45.676327 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.676296    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:45.829614 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.829584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8f6j\" (UniqueName: \"kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j\") pod \"authorino-58cd955675-wgtkt\" (UID: \"2d2617a9-8402-4df3-a362-71f394425295\") " pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:45.930296 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.930217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8f6j\" (UniqueName: \"kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j\") pod \"authorino-58cd955675-wgtkt\" (UID: \"2d2617a9-8402-4df3-a362-71f394425295\") " pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:45.945175 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.945142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8f6j\" (UniqueName: \"kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j\") pod \"authorino-58cd955675-wgtkt\" (UID: \"2d2617a9-8402-4df3-a362-71f394425295\") " pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:45.977907 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:45.977874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:46.122787 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:46.122765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:46.124920 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:47:46.124899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d2617a9_8402_4df3_a362_71f394425295.slice/crio-f13fdacbb3230153e9a997f008e440a6c2427a11ef0249dd20b6533fb8fbd2e4 WatchSource:0}: Error finding container f13fdacbb3230153e9a997f008e440a6c2427a11ef0249dd20b6533fb8fbd2e4: Status 404 returned error can't find the container with id f13fdacbb3230153e9a997f008e440a6c2427a11ef0249dd20b6533fb8fbd2e4
Jul 15 19:47:46.338858 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:46.338828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgtkt" event={"ID":"2d2617a9-8402-4df3-a362-71f394425295","Type":"ContainerStarted","Data":"f13fdacbb3230153e9a997f008e440a6c2427a11ef0249dd20b6533fb8fbd2e4"}
Jul 15 19:47:50.361528 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:50.361491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgtkt" event={"ID":"2d2617a9-8402-4df3-a362-71f394425295","Type":"ContainerStarted","Data":"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"}
Jul 15 19:47:50.378468 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:50.378424    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wgtkt" podStartSLOduration=2.121857236 podStartE2EDuration="5.378410786s" totalImagesPullingTime="3.25655355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:50.37765785 +0000 UTC m=+553.781038486" watchObservedRunningTime="2026-07-15 19:47:50.378410786 +0000 UTC m=+553.781791423"
Jul 15 19:47:52.895586 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:52.895544    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:52.895998 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:52.895736    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wgtkt" podUID="2d2617a9-8402-4df3-a362-71f394425295" containerName="authorino" containerID="cri-o://710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e" gracePeriod=30
Jul 15 19:47:53.144844 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.144818    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:53.197022 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.196951    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8f6j\" (UniqueName: \"kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j\") pod \"2d2617a9-8402-4df3-a362-71f394425295\" (UID: \"2d2617a9-8402-4df3-a362-71f394425295\") "
Jul 15 19:47:53.199192 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.199161    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j" (OuterVolumeSpecName: "kube-api-access-k8f6j") pod "2d2617a9-8402-4df3-a362-71f394425295" (UID: "2d2617a9-8402-4df3-a362-71f394425295"). InnerVolumeSpecName "kube-api-access-k8f6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:53.298414 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.298379    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8f6j\" (UniqueName: \"kubernetes.io/projected/2d2617a9-8402-4df3-a362-71f394425295-kube-api-access-k8f6j\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:47:53.376021 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.375986    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d2617a9-8402-4df3-a362-71f394425295" containerID="710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e" exitCode=0
Jul 15 19:47:53.376221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.376035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wgtkt"
Jul 15 19:47:53.376221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.376065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgtkt" event={"ID":"2d2617a9-8402-4df3-a362-71f394425295","Type":"ContainerDied","Data":"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"}
Jul 15 19:47:53.376221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.376105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wgtkt" event={"ID":"2d2617a9-8402-4df3-a362-71f394425295","Type":"ContainerDied","Data":"f13fdacbb3230153e9a997f008e440a6c2427a11ef0249dd20b6533fb8fbd2e4"}
Jul 15 19:47:53.376221 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.376128    2580 scope.go:117] "RemoveContainer" containerID="710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"
Jul 15 19:47:53.384693 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.384675    2580 scope.go:117] "RemoveContainer" containerID="710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"
Jul 15 19:47:53.384952 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:47:53.384933    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e\": container with ID starting with 710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e not found: ID does not exist" containerID="710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"
Jul 15 19:47:53.385022 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.384960    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e"} err="failed to get container status \"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e\": rpc error: code = NotFound desc = could not find container \"710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e\": container with ID starting with 710110e091054e32f83666d6168c1877534c1790550e107717fb59b43b311e9e not found: ID does not exist"
Jul 15 19:47:53.405760 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.405734    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:53.410642 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:53.410624    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wgtkt"]
Jul 15 19:47:55.117761 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:47:55.117729    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d2617a9-8402-4df3-a362-71f394425295" path="/var/lib/kubelet/pods/2d2617a9-8402-4df3-a362-71f394425295/volumes"
Jul 15 19:48:21.849006 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.848963    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:21.849606 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.849433    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2617a9-8402-4df3-a362-71f394425295" containerName="authorino"
Jul 15 19:48:21.849606 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.849453    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2617a9-8402-4df3-a362-71f394425295" containerName="authorino"
Jul 15 19:48:21.849606 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.849595    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d2617a9-8402-4df3-a362-71f394425295" containerName="authorino"
Jul 15 19:48:21.855470 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.855449    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:21.857979 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.857956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-78smg\""
Jul 15 19:48:21.860277 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.860256    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:21.939309 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:21.939282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpw7\" (UniqueName: \"kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7\") pod \"authorino-5469647c97-fmggh\" (UID: \"c33757e1-df56-4aab-8f5f-22578f0d7be1\") " pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:22.040104 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.040078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpw7\" (UniqueName: \"kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7\") pod \"authorino-5469647c97-fmggh\" (UID: \"c33757e1-df56-4aab-8f5f-22578f0d7be1\") " pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:22.051708 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.051689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpw7\" (UniqueName: \"kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7\") pod \"authorino-5469647c97-fmggh\" (UID: \"c33757e1-df56-4aab-8f5f-22578f0d7be1\") " pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:22.127254 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.127170    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:22.127499 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.127467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:22.191260 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.191228    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:48:22.196023 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.196001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.198845 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.198717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 19:48:22.207498 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.207438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:48:22.279202 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.279177    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:22.280892 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:48:22.280863    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc33757e1_df56_4aab_8f5f_22578f0d7be1.slice/crio-357835bf08b5f1f1e11601d685c331368e131ccd1ffe9d1f4be4a680bc41a19d WatchSource:0}: Error finding container 357835bf08b5f1f1e11601d685c331368e131ccd1ffe9d1f4be4a680bc41a19d: Status 404 returned error can't find the container with id 357835bf08b5f1f1e11601d685c331368e131ccd1ffe9d1f4be4a680bc41a19d
Jul 15 19:48:22.343155 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.343127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgdzr\" (UniqueName: \"kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.343281 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.343196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.444086 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.444003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.444086 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.444054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgdzr\" (UniqueName: \"kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.446693 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.446665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.454197 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.454168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgdzr\" (UniqueName: \"kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr\") pod \"authorino-7d87494bbf-nj52s\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") " pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.506148 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.506110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5469647c97-fmggh" event={"ID":"c33757e1-df56-4aab-8f5f-22578f0d7be1","Type":"ContainerStarted","Data":"357835bf08b5f1f1e11601d685c331368e131ccd1ffe9d1f4be4a680bc41a19d"}
Jul 15 19:48:22.507509 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.507457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:48:22.638709 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:22.638687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:48:22.640993 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:48:22.640970    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0eec7a2_2508_48af_b0b7_cd78a6032d77.slice/crio-d20ba80628c239282d2d67c691560f19a260ed25690f90a731669d009089c835 WatchSource:0}: Error finding container d20ba80628c239282d2d67c691560f19a260ed25690f90a731669d009089c835: Status 404 returned error can't find the container with id d20ba80628c239282d2d67c691560f19a260ed25690f90a731669d009089c835
Jul 15 19:48:23.511689 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.511658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5469647c97-fmggh" event={"ID":"c33757e1-df56-4aab-8f5f-22578f0d7be1","Type":"ContainerStarted","Data":"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"}
Jul 15 19:48:23.512082 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.511710    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5469647c97-fmggh" podUID="c33757e1-df56-4aab-8f5f-22578f0d7be1" containerName="authorino" containerID="cri-o://8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027" gracePeriod=30
Jul 15 19:48:23.513261 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.513236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d87494bbf-nj52s" event={"ID":"d0eec7a2-2508-48af-b0b7-cd78a6032d77","Type":"ContainerStarted","Data":"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"}
Jul 15 19:48:23.513360 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.513269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d87494bbf-nj52s" event={"ID":"d0eec7a2-2508-48af-b0b7-cd78a6032d77","Type":"ContainerStarted","Data":"d20ba80628c239282d2d67c691560f19a260ed25690f90a731669d009089c835"}
Jul 15 19:48:23.562605 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.562567    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5469647c97-fmggh" podStartSLOduration=2.245699484 podStartE2EDuration="2.562552337s" totalImagesPullingTime="316.852853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:23.561800957 +0000 UTC m=+586.965181596" watchObservedRunningTime="2026-07-15 19:48:23.562552337 +0000 UTC m=+586.965932973"
Jul 15 19:48:23.592852 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.592809    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d87494bbf-nj52s" podStartSLOduration=1.234826544 podStartE2EDuration="1.59279243s" totalImagesPullingTime="357.965886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:23.591705791 +0000 UTC m=+586.995086431" watchObservedRunningTime="2026-07-15 19:48:23.59279243 +0000 UTC m=+586.996173063"
Jul 15 19:48:23.786365 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.786312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:23.857757 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.857726    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxpw7\" (UniqueName: \"kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7\") pod \"c33757e1-df56-4aab-8f5f-22578f0d7be1\" (UID: \"c33757e1-df56-4aab-8f5f-22578f0d7be1\") "
Jul 15 19:48:23.859852 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.859826    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7" (OuterVolumeSpecName: "kube-api-access-nxpw7") pod "c33757e1-df56-4aab-8f5f-22578f0d7be1" (UID: "c33757e1-df56-4aab-8f5f-22578f0d7be1"). InnerVolumeSpecName "kube-api-access-nxpw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:23.958696 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:23.958668    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxpw7\" (UniqueName: \"kubernetes.io/projected/c33757e1-df56-4aab-8f5f-22578f0d7be1-kube-api-access-nxpw7\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:48:24.519312 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.519278    2580 generic.go:356] "Generic (PLEG): container finished" podID="c33757e1-df56-4aab-8f5f-22578f0d7be1" containerID="8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027" exitCode=0
Jul 15 19:48:24.519312 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.519317    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5469647c97-fmggh"
Jul 15 19:48:24.519859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.519363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5469647c97-fmggh" event={"ID":"c33757e1-df56-4aab-8f5f-22578f0d7be1","Type":"ContainerDied","Data":"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"}
Jul 15 19:48:24.519859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.519427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5469647c97-fmggh" event={"ID":"c33757e1-df56-4aab-8f5f-22578f0d7be1","Type":"ContainerDied","Data":"357835bf08b5f1f1e11601d685c331368e131ccd1ffe9d1f4be4a680bc41a19d"}
Jul 15 19:48:24.519859 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.519453    2580 scope.go:117] "RemoveContainer" containerID="8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"
Jul 15 19:48:24.528005 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.527985    2580 scope.go:117] "RemoveContainer" containerID="8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"
Jul 15 19:48:24.528245 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:48:24.528228    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027\": container with ID starting with 8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027 not found: ID does not exist" containerID="8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"
Jul 15 19:48:24.528304 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.528259    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027"} err="failed to get container status \"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027\": rpc error: code = NotFound desc = could not find container \"8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027\": container with ID starting with 8f01348013943a2cab87746fac33cf0e965fa7b64f8c6ce932cd98fe30796027 not found: ID does not exist"
Jul 15 19:48:24.541936 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.541909    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:24.544076 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:24.544056    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5469647c97-fmggh"]
Jul 15 19:48:25.117605 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:25.117577    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c33757e1-df56-4aab-8f5f-22578f0d7be1" path="/var/lib/kubelet/pods/c33757e1-df56-4aab-8f5f-22578f0d7be1/volumes"
Jul 15 19:48:36.977605 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:36.977578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:48:36.979426 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:48:36.979403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:50:09.955020 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.954989    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"]
Jul 15 19:50:09.955428 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.955312    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c33757e1-df56-4aab-8f5f-22578f0d7be1" containerName="authorino"
Jul 15 19:50:09.955428 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.955322    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c33757e1-df56-4aab-8f5f-22578f0d7be1" containerName="authorino"
Jul 15 19:50:09.955428 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.955390    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c33757e1-df56-4aab-8f5f-22578f0d7be1" containerName="authorino"
Jul 15 19:50:09.958278 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.958260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:09.961023 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.960996    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 19:50:09.961156 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.960996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 19:50:09.961156 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.961004    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 19:50:09.961156 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.961049    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nmvtf\""
Jul 15 19:50:09.970361 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:09.970336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"]
Jul 15 19:50:10.063818 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbxkv\" (UniqueName: \"kubernetes.io/projected/793785d9-5eb6-4afb-852d-4c6ee13de688-kube-api-access-pbxkv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.064000 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.064000 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.064000 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.064000 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/793785d9-5eb6-4afb-852d-4c6ee13de688-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.064000 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.063990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165238 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165444 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbxkv\" (UniqueName: \"kubernetes.io/projected/793785d9-5eb6-4afb-852d-4c6ee13de688-kube-api-access-pbxkv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165444 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165444 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165645 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165645 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/793785d9-5eb6-4afb-852d-4c6ee13de688-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165749 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165803 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.165851 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.165836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.167717 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.167691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/793785d9-5eb6-4afb-852d-4c6ee13de688-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.168176 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.168156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/793785d9-5eb6-4afb-852d-4c6ee13de688-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.174844 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.174819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbxkv\" (UniqueName: \"kubernetes.io/projected/793785d9-5eb6-4afb-852d-4c6ee13de688-kube-api-access-pbxkv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cl2m8\" (UID: \"793785d9-5eb6-4afb-852d-4c6ee13de688\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.269975 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.269945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:10.405126 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.405105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"]
Jul 15 19:50:10.407095 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:50:10.407062    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793785d9_5eb6_4afb_852d_4c6ee13de688.slice/crio-cac4c7e063c356739b2a85deb23c72170fe7bc7a9aedb64546bc1196bc38685d WatchSource:0}: Error finding container cac4c7e063c356739b2a85deb23c72170fe7bc7a9aedb64546bc1196bc38685d: Status 404 returned error can't find the container with id cac4c7e063c356739b2a85deb23c72170fe7bc7a9aedb64546bc1196bc38685d
Jul 15 19:50:10.408826 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.408810    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:50:10.980352 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:10.980315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8" event={"ID":"793785d9-5eb6-4afb-852d-4c6ee13de688","Type":"ContainerStarted","Data":"cac4c7e063c356739b2a85deb23c72170fe7bc7a9aedb64546bc1196bc38685d"}
Jul 15 19:50:11.987793 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:11.987698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8" event={"ID":"793785d9-5eb6-4afb-852d-4c6ee13de688","Type":"ContainerStarted","Data":"5d90abb0230ba78e68c17cc7e7bc121f79cf5c95b3a0f5e2e40c4dede9b15eae"}
Jul 15 19:50:12.015899 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:12.015839    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8" podStartSLOduration=1.732115913 podStartE2EDuration="3.015819469s" totalImagesPullingTime="1.283703556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:50:12.014692296 +0000 UTC m=+695.418072933" watchObservedRunningTime="2026-07-15 19:50:12.015819469 +0000 UTC m=+695.419200104"
Jul 15 19:50:20.270662 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:20.270623    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:20.271133 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:20.270705    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:20.285392 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:20.285367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:21.039163 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:21.039137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cl2m8"
Jul 15 19:50:39.653855 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.653824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"]
Jul 15 19:50:39.657054 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.657030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.659934 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.659911    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 19:50:39.678169 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.678145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"]
Jul 15 19:50:39.831212 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43c3641-5644-467a-bc86-a26e5bad42df-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.831363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.831363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.831363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.831363 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.831537 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.831357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dzfv\" (UniqueName: \"kubernetes.io/projected/b43c3641-5644-467a-bc86-a26e5bad42df-kube-api-access-4dzfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932687 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dzfv\" (UniqueName: \"kubernetes.io/projected/b43c3641-5644-467a-bc86-a26e5bad42df-kube-api-access-4dzfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43c3641-5644-467a-bc86-a26e5bad42df-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.932930 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.932784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.933057 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.933031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.933168 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.933100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.933211 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.933179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.935125 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.935107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b43c3641-5644-467a-bc86-a26e5bad42df-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.935368 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.935347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b43c3641-5644-467a-bc86-a26e5bad42df-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.948434 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.948406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dzfv\" (UniqueName: \"kubernetes.io/projected/b43c3641-5644-467a-bc86-a26e5bad42df-kube-api-access-4dzfv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-px4j5\" (UID: \"b43c3641-5644-467a-bc86-a26e5bad42df\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:39.969364 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:39.969331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:40.110660 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:40.110630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"]
Jul 15 19:50:40.111930 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:50:40.111908    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43c3641_5644_467a_bc86_a26e5bad42df.slice/crio-bcd3ad2070b7c7d0e7f16f93c5a73dc8a0714e49f0e74b8c7598af5461d4902f WatchSource:0}: Error finding container bcd3ad2070b7c7d0e7f16f93c5a73dc8a0714e49f0e74b8c7598af5461d4902f: Status 404 returned error can't find the container with id bcd3ad2070b7c7d0e7f16f93c5a73dc8a0714e49f0e74b8c7598af5461d4902f
Jul 15 19:50:41.117292 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.117257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5" event={"ID":"b43c3641-5644-467a-bc86-a26e5bad42df","Type":"ContainerStarted","Data":"52baf6d9983f5ba2cf46d8491639a13cd850570eee14c97ea971ca4b03b41310"}
Jul 15 19:50:41.117694 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.117307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5" event={"ID":"b43c3641-5644-467a-bc86-a26e5bad42df","Type":"ContainerStarted","Data":"bcd3ad2070b7c7d0e7f16f93c5a73dc8a0714e49f0e74b8c7598af5461d4902f"}
Jul 15 19:50:41.135426 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.135376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5" podStartSLOduration=1.933934298 podStartE2EDuration="2.135359281s" totalImagesPullingTime="201.424983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:50:41.135249168 +0000 UTC m=+724.538629805" watchObservedRunningTime="2026-07-15 19:50:41.135359281 +0000 UTC m=+724.538739918"
Jul 15 19:50:41.936048 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.936010    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"]
Jul 15 19:50:41.939381 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.939362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:41.941852 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.941831    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 19:50:41.951943 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:41.951925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"]
Jul 15 19:50:42.050253 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.050415 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.050415 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.050415 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtlz\" (UniqueName: \"kubernetes.io/projected/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-kube-api-access-2rtlz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.050555 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.050555 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.050514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.151762 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.151762 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtlz\" (UniqueName: \"kubernetes.io/projected/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-kube-api-access-2rtlz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.151963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.152196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152274 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.152212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.152561 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.152363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.154738 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.154716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.155139 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.155118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.160587 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.160563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtlz\" (UniqueName: \"kubernetes.io/projected/1a5acbe5-138f-4207-b8e5-e0f40ac1af92-kube-api-access-2rtlz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn\" (UID: \"1a5acbe5-138f-4207-b8e5-e0f40ac1af92\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.248731 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.248692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:42.397695 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:42.397672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"]
Jul 15 19:50:42.399852 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:50:42.399826    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a5acbe5_138f_4207_b8e5_e0f40ac1af92.slice/crio-2fb68548f54123a4ac8ed5d97400ec4a00cd7477c964349a4c83a679996ee98a WatchSource:0}: Error finding container 2fb68548f54123a4ac8ed5d97400ec4a00cd7477c964349a4c83a679996ee98a: Status 404 returned error can't find the container with id 2fb68548f54123a4ac8ed5d97400ec4a00cd7477c964349a4c83a679996ee98a
Jul 15 19:50:43.128957 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:43.128922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn" event={"ID":"1a5acbe5-138f-4207-b8e5-e0f40ac1af92","Type":"ContainerStarted","Data":"bc2512de6cec5980b97dfe688237e0be66cc666865f05ef7d55e2c039fa48c58"}
Jul 15 19:50:43.128957 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:43.128961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn" event={"ID":"1a5acbe5-138f-4207-b8e5-e0f40ac1af92","Type":"ContainerStarted","Data":"2fb68548f54123a4ac8ed5d97400ec4a00cd7477c964349a4c83a679996ee98a"}
Jul 15 19:50:43.150897 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:43.150833    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn" podStartSLOduration=1.97588097 podStartE2EDuration="2.150813161s" totalImagesPullingTime="174.932191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:50:43.148926543 +0000 UTC m=+726.552307180" watchObservedRunningTime="2026-07-15 19:50:43.150813161 +0000 UTC m=+726.554193798"
Jul 15 19:50:49.969876 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:49.969841    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:49.970372 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:49.969919    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:49.982031 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:49.982011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:50.171329 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:50.171303    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-px4j5"
Jul 15 19:50:52.249887 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:52.249856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:52.249887 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:52.249900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:52.262203 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:52.262174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:50:53.188212 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:50:53.188186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn"
Jul 15 19:52:03.195174 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.195100    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:52:03.195647 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.195322    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7d87494bbf-nj52s" podUID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" containerName="authorino" containerID="cri-o://e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8" gracePeriod=30
Jul 15 19:52:03.446466 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.446389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:52:03.487814 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.487781    2580 generic.go:356] "Generic (PLEG): container finished" podID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" containerID="e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8" exitCode=0
Jul 15 19:52:03.487960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.487821    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d87494bbf-nj52s"
Jul 15 19:52:03.487960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.487844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d87494bbf-nj52s" event={"ID":"d0eec7a2-2508-48af-b0b7-cd78a6032d77","Type":"ContainerDied","Data":"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"}
Jul 15 19:52:03.487960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.487881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d87494bbf-nj52s" event={"ID":"d0eec7a2-2508-48af-b0b7-cd78a6032d77","Type":"ContainerDied","Data":"d20ba80628c239282d2d67c691560f19a260ed25690f90a731669d009089c835"}
Jul 15 19:52:03.487960 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.487901    2580 scope.go:117] "RemoveContainer" containerID="e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"
Jul 15 19:52:03.497771 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.497746    2580 scope.go:117] "RemoveContainer" containerID="e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"
Jul 15 19:52:03.498045 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:52:03.498026    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8\": container with ID starting with e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8 not found: ID does not exist" containerID="e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"
Jul 15 19:52:03.498106 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.498056    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8"} err="failed to get container status \"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8\": rpc error: code = NotFound desc = could not find container \"e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8\": container with ID starting with e632eca635ba0441a11065b198b14d1618ddc85c0ac87b1ea5215a5ed568a9d8 not found: ID does not exist"
Jul 15 19:52:03.567581 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.567550    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgdzr\" (UniqueName: \"kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr\") pod \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") "
Jul 15 19:52:03.567774 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.567625    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert\") pod \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\" (UID: \"d0eec7a2-2508-48af-b0b7-cd78a6032d77\") "
Jul 15 19:52:03.569842 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.569816    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr" (OuterVolumeSpecName: "kube-api-access-pgdzr") pod "d0eec7a2-2508-48af-b0b7-cd78a6032d77" (UID: "d0eec7a2-2508-48af-b0b7-cd78a6032d77"). InnerVolumeSpecName "kube-api-access-pgdzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:52:03.578097 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.578075    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d0eec7a2-2508-48af-b0b7-cd78a6032d77" (UID: "d0eec7a2-2508-48af-b0b7-cd78a6032d77"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:52:03.668807 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.668772    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0eec7a2-2508-48af-b0b7-cd78a6032d77-tls-cert\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:52:03.668807 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.668799    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgdzr\" (UniqueName: \"kubernetes.io/projected/d0eec7a2-2508-48af-b0b7-cd78a6032d77-kube-api-access-pgdzr\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:52:03.809658 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.809627    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:52:03.811144 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:03.811126    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d87494bbf-nj52s"]
Jul 15 19:52:05.117128 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:52:05.117095    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" path="/var/lib/kubelet/pods/d0eec7a2-2508-48af-b0b7-cd78a6032d77/volumes"
Jul 15 19:53:37.007420 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:53:37.007334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:53:37.007982 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:53:37.007500    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:58:08.403889 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:08.403796    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:58:08.404468 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:08.403978    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" podUID="949e59b1-8886-4d40-b282-8a1c7c27cbab" containerName="manager" containerID="cri-o://5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a" gracePeriod=10
Jul 15 19:58:11.056640 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.056614    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:58:11.111049 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.111021    2580 generic.go:356] "Generic (PLEG): container finished" podID="949e59b1-8886-4d40-b282-8a1c7c27cbab" containerID="5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a" exitCode=0
Jul 15 19:58:11.111215 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.111081    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"
Jul 15 19:58:11.111215 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.111110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" event={"ID":"949e59b1-8886-4d40-b282-8a1c7c27cbab","Type":"ContainerDied","Data":"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"}
Jul 15 19:58:11.111215 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.111208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr" event={"ID":"949e59b1-8886-4d40-b282-8a1c7c27cbab","Type":"ContainerDied","Data":"701feed47c77327224a25f46319d80b36c05e7f9772a9cca3540a8594b66e9ac"}
Jul 15 19:58:11.111378 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.111240    2580 scope.go:117] "RemoveContainer" containerID="5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"
Jul 15 19:58:11.121622 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.121599    2580 scope.go:117] "RemoveContainer" containerID="5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"
Jul 15 19:58:11.121887 ip-10-0-141-1 kubenswrapper[2580]: E0715 19:58:11.121866    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a\": container with ID starting with 5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a not found: ID does not exist" containerID="5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"
Jul 15 19:58:11.121947 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.121899    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a"} err="failed to get container status \"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a\": rpc error: code = NotFound desc = could not find container \"5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a\": container with ID starting with 5273cb270796e0bc790cbee5a4f5b9f633343c9d59510239caa22ae830b6187a not found: ID does not exist"
Jul 15 19:58:11.162297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.162245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck5d7\" (UniqueName: \"kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7\") pod \"949e59b1-8886-4d40-b282-8a1c7c27cbab\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") "
Jul 15 19:58:11.162297 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.162293    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume\") pod \"949e59b1-8886-4d40-b282-8a1c7c27cbab\" (UID: \"949e59b1-8886-4d40-b282-8a1c7c27cbab\") "
Jul 15 19:58:11.162701 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.162681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "949e59b1-8886-4d40-b282-8a1c7c27cbab" (UID: "949e59b1-8886-4d40-b282-8a1c7c27cbab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:58:11.164335 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.164306    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7" (OuterVolumeSpecName: "kube-api-access-ck5d7") pod "949e59b1-8886-4d40-b282-8a1c7c27cbab" (UID: "949e59b1-8886-4d40-b282-8a1c7c27cbab"). InnerVolumeSpecName "kube-api-access-ck5d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:58:11.263902 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.263877    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck5d7\" (UniqueName: \"kubernetes.io/projected/949e59b1-8886-4d40-b282-8a1c7c27cbab-kube-api-access-ck5d7\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:58:11.263902 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.263897    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/949e59b1-8886-4d40-b282-8a1c7c27cbab-extensions-socket-volume\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 19:58:11.437968 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.437939    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:58:11.442449 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:11.442426    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xnrnr"]
Jul 15 19:58:13.118553 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:13.118520    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949e59b1-8886-4d40-b282-8a1c7c27cbab" path="/var/lib/kubelet/pods/949e59b1-8886-4d40-b282-8a1c7c27cbab/volumes"
Jul 15 19:58:37.032371 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:37.032342    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:58:37.033886 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:58:37.033867    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 19:59:09.506632 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.506600    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"]
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.506941    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949e59b1-8886-4d40-b282-8a1c7c27cbab" containerName="manager"
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.506953    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="949e59b1-8886-4d40-b282-8a1c7c27cbab" containerName="manager"
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.506984    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" containerName="authorino"
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.506992    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" containerName="authorino"
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.507041    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="949e59b1-8886-4d40-b282-8a1c7c27cbab" containerName="manager"
Jul 15 19:59:09.507088 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.507055    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0eec7a2-2508-48af-b0b7-cd78a6032d77" containerName="authorino"
Jul 15 19:59:09.509740 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.509724    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.512259 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.512235    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-442lt\""
Jul 15 19:59:09.512411 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.512377    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:59:09.512637 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.512625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:59:09.521603 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.521581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"]
Jul 15 19:59:09.653916 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.653879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0165014-a388-4d8d-8cb1-5cba54feb276-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.654108 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.653944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5bcz\" (UniqueName: \"kubernetes.io/projected/b0165014-a388-4d8d-8cb1-5cba54feb276-kube-api-access-t5bcz\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.754793 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.754761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0165014-a388-4d8d-8cb1-5cba54feb276-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.754956 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.754842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5bcz\" (UniqueName: \"kubernetes.io/projected/b0165014-a388-4d8d-8cb1-5cba54feb276-kube-api-access-t5bcz\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.755202 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.755179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0165014-a388-4d8d-8cb1-5cba54feb276-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.763429 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.763370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5bcz\" (UniqueName: \"kubernetes.io/projected/b0165014-a388-4d8d-8cb1-5cba54feb276-kube-api-access-t5bcz\") pod \"kuadrant-operator-controller-manager-86878c769f-zwfxw\" (UID: \"b0165014-a388-4d8d-8cb1-5cba54feb276\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.820443 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.820415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:09.957025 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:09.957004    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"]
Jul 15 19:59:09.959578 ip-10-0-141-1 kubenswrapper[2580]: W0715 19:59:09.959542    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0165014_a388_4d8d_8cb1_5cba54feb276.slice/crio-7e3aa26e346eafb3d5d8d381e52208eba6c938d1b42a666dbe2f11caa983e826 WatchSource:0}: Error finding container 7e3aa26e346eafb3d5d8d381e52208eba6c938d1b42a666dbe2f11caa983e826: Status 404 returned error can't find the container with id 7e3aa26e346eafb3d5d8d381e52208eba6c938d1b42a666dbe2f11caa983e826
Jul 15 19:59:10.375836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:10.375748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw" event={"ID":"b0165014-a388-4d8d-8cb1-5cba54feb276","Type":"ContainerStarted","Data":"241c090642ce85151a75b82cf400c0c55b63b843da3b40f564c074c902459794"}
Jul 15 19:59:10.375836 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:10.375797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw" event={"ID":"b0165014-a388-4d8d-8cb1-5cba54feb276","Type":"ContainerStarted","Data":"7e3aa26e346eafb3d5d8d381e52208eba6c938d1b42a666dbe2f11caa983e826"}
Jul 15 19:59:10.376019 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:10.375866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 19:59:10.396894 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:10.396825    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw" podStartSLOduration=1.396810984 podStartE2EDuration="1.396810984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:59:10.395594432 +0000 UTC m=+1233.798975069" watchObservedRunningTime="2026-07-15 19:59:10.396810984 +0000 UTC m=+1233.800191619"
Jul 15 19:59:21.383016 ip-10-0-141-1 kubenswrapper[2580]: I0715 19:59:21.382981    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zwfxw"
Jul 15 20:03:37.058164 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:03:37.058136    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:03:37.061586 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:03:37.061568    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:08:37.083441 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:08:37.083403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:08:37.087522 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:08:37.087499    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:13:37.117974 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:13:37.117947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:13:37.121526 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:13:37.121506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:14:29.844173 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.844096    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:14:29.847797 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.847775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.852864 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.852840    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8950fff5\"/\"kube-root-ca.crt\""
Jul 15 20:14:29.853759 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.853735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8950fff5\"/\"e2e-lifecycle-model-8950fff5-kserve-self-signed-certs\""
Jul 15 20:14:29.853864 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.853748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8950fff5\"/\"openshift-service-ca.crt\""
Jul 15 20:14:29.853864 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.853771    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8950fff5\"/\"default-dockercfg-pdr62\""
Jul 15 20:14:29.864573 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.864551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:14:29.934011 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.933980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx47h\" (UniqueName: \"kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.934182 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.934026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.934182 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.934047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.934182 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.934110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.934182 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.934167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:29.934315 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:29.934198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034653 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034653 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034881 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034881 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034881 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx47h\" (UniqueName: \"kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.034881 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.034796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.035112 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.035089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.035166 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.035127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.035203 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.035167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.037128 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.037109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.037301 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.037284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.044851 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.044831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx47h\" (UniqueName: \"kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h\") pod \"e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") " pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.157436 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.157351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:30.325799 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.325776    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:14:30.327707 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:14:30.327678    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd45126f3_156b_4da3_a89d_115dc2d5595e.slice/crio-94014b74807edc1ed8e09676b3fbd2846c066620c6bae7f6a28f748c5d6abc85 WatchSource:0}: Error finding container 94014b74807edc1ed8e09676b3fbd2846c066620c6bae7f6a28f748c5d6abc85: Status 404 returned error can't find the container with id 94014b74807edc1ed8e09676b3fbd2846c066620c6bae7f6a28f748c5d6abc85
Jul 15 20:14:30.435313 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.435229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" event={"ID":"d45126f3-156b-4da3-a89d-115dc2d5595e","Type":"ContainerStarted","Data":"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"}
Jul 15 20:14:30.435313 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.435276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" event={"ID":"d45126f3-156b-4da3-a89d-115dc2d5595e","Type":"ContainerStarted","Data":"94014b74807edc1ed8e09676b3fbd2846c066620c6bae7f6a28f748c5d6abc85"}
Jul 15 20:14:30.501989 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:30.501933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" podStartSLOduration=1.5019179390000001 podStartE2EDuration="1.501917939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:14:30.499657599 +0000 UTC m=+2153.903038217" watchObservedRunningTime="2026-07-15 20:14:30.501917939 +0000 UTC m=+2153.905298621"
Jul 15 20:14:40.158445 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:40.158408    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:40.158873 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:40.158509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:40.177806 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:40.177777    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:14:40.502955 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:14:40.502927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:15:33.790073 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:33.790034    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:15:48.811233 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:48.811170    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" podUID="d45126f3-156b-4da3-a89d-115dc2d5595e" containerName="main" containerID="cri-o://e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab" gracePeriod=45
Jul 15 20:15:49.059818 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.059793    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:15:49.229116 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229030    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229116 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229078    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx47h\" (UniqueName: \"kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229330 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229330 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229330 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229330 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache\") pod \"d45126f3-156b-4da3-a89d-115dc2d5595e\" (UID: \"d45126f3-156b-4da3-a89d-115dc2d5595e\") "
Jul 15 20:15:49.229570 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:15:49.229570 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229403    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home" (OuterVolumeSpecName: "home") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:15:49.229570 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229547    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.229570 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229565    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.229721 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.229607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache" (OuterVolumeSpecName: "model-cache") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:15:49.231515 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.231471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm" (OuterVolumeSpecName: "dshm") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:15:49.231634 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.231521    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h" (OuterVolumeSpecName: "kube-api-access-nx47h") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "kube-api-access-nx47h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:15:49.237436 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.231590    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d45126f3-156b-4da3-a89d-115dc2d5595e" (UID: "d45126f3-156b-4da3-a89d-115dc2d5595e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:15:49.330390 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.330346    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d45126f3-156b-4da3-a89d-115dc2d5595e-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.330390 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.330385    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.330621 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.330400    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx47h\" (UniqueName: \"kubernetes.io/projected/d45126f3-156b-4da3-a89d-115dc2d5595e-kube-api-access-nx47h\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.330621 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.330412    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d45126f3-156b-4da3-a89d-115dc2d5595e-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:15:49.797034 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.796996    2580 generic.go:356] "Generic (PLEG): container finished" podID="d45126f3-156b-4da3-a89d-115dc2d5595e" containerID="e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab" exitCode=0
Jul 15 20:15:49.797217 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.797051    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"
Jul 15 20:15:49.797217 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.797083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" event={"ID":"d45126f3-156b-4da3-a89d-115dc2d5595e","Type":"ContainerDied","Data":"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"}
Jul 15 20:15:49.797217 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.797126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w" event={"ID":"d45126f3-156b-4da3-a89d-115dc2d5595e","Type":"ContainerDied","Data":"94014b74807edc1ed8e09676b3fbd2846c066620c6bae7f6a28f748c5d6abc85"}
Jul 15 20:15:49.797217 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.797145    2580 scope.go:117] "RemoveContainer" containerID="e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"
Jul 15 20:15:49.806534 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.806520    2580 scope.go:117] "RemoveContainer" containerID="e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"
Jul 15 20:15:49.806853 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:15:49.806835    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab\": container with ID starting with e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab not found: ID does not exist" containerID="e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"
Jul 15 20:15:49.806908 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.806860    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab"} err="failed to get container status \"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab\": rpc error: code = NotFound desc = could not find container \"e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab\": container with ID starting with e5e509c31789b72e347c11454fe8a2a7de0b53a38583a535a8a8932787ebacab not found: ID does not exist"
Jul 15 20:15:49.822540 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.822514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:15:49.827822 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:49.827802    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8950fff5/e2e-lifecycle-model-8950fff5-kserve-cb44bd699-nhr2w"]
Jul 15 20:15:51.118300 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:15:51.118268    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45126f3-156b-4da3-a89d-115dc2d5595e" path="/var/lib/kubelet/pods/d45126f3-156b-4da3-a89d-115dc2d5595e/volumes"
Jul 15 20:17:51.562358 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.562326    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:17:51.562827 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.562714    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d45126f3-156b-4da3-a89d-115dc2d5595e" containerName="main"
Jul 15 20:17:51.562827 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.562730    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d45126f3-156b-4da3-a89d-115dc2d5595e" containerName="main"
Jul 15 20:17:51.562827 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.562814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d45126f3-156b-4da3-a89d-115dc2d5595e" containerName="main"
Jul 15 20:17:51.565698 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.565677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.568647 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.568627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c923f1\"/\"default-dockercfg-jl4zq\""
Jul 15 20:17:51.569566 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.569550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c923f1\"/\"kube-root-ca.crt\""
Jul 15 20:17:51.569666 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.569602    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c923f1\"/\"openshift-service-ca.crt\""
Jul 15 20:17:51.569666 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.569662    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c923f1\"/\"test-model-c923f1-kserve-self-signed-certs\""
Jul 15 20:17:51.589696 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.589664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:17:51.746520 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.746704 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.746704 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.746704 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.746857 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8hd\" (UniqueName: \"kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.746857 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.746748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848240 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848240 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848240 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848527 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848527 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8hd\" (UniqueName: \"kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848527 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848729 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848793 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.848793 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.848773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.850559 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.850541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.850806 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.850789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.858088 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.858066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8hd\" (UniqueName: \"kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd\") pod \"test-model-c923f1-kserve-7f8688f46f-grzpz\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") " pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:51.875191 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:51.875166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:17:52.009196 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:52.009170    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:17:52.011415 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:17:52.011387    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ad60f68_7b42_4333_bad1_bd868af68f62.slice/crio-3d12b70117b6858be1fc551ba80ec352e6ccbe06d8dc02d5ffa8a4715355bde6 WatchSource:0}: Error finding container 3d12b70117b6858be1fc551ba80ec352e6ccbe06d8dc02d5ffa8a4715355bde6: Status 404 returned error can't find the container with id 3d12b70117b6858be1fc551ba80ec352e6ccbe06d8dc02d5ffa8a4715355bde6
Jul 15 20:17:52.341443 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:52.341403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" event={"ID":"0ad60f68-7b42-4333-bad1-bd868af68f62","Type":"ContainerStarted","Data":"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"}
Jul 15 20:17:52.341443 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:52.341444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" event={"ID":"0ad60f68-7b42-4333-bad1-bd868af68f62","Type":"ContainerStarted","Data":"3d12b70117b6858be1fc551ba80ec352e6ccbe06d8dc02d5ffa8a4715355bde6"}
Jul 15 20:17:52.361871 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:17:52.361816    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" podStartSLOduration=1.361796456 podStartE2EDuration="1.361796456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:17:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:17:52.359059675 +0000 UTC m=+2355.762440314" watchObservedRunningTime="2026-07-15 20:17:52.361796456 +0000 UTC m=+2355.765177094"
Jul 15 20:18:01.875553 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:01.875513    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:18:01.876133 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:01.875568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:18:01.888425 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:01.888396    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:18:02.397108 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:02.397075    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:18:37.042454 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.042421    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:18:37.045843 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.045828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.048362 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.048343    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a27bd5\"/\"openshift-service-ca.crt\""
Jul 15 20:18:37.049102 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.049080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a27bd5\"/\"kube-root-ca.crt\""
Jul 15 20:18:37.049102 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.049082    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a27bd5\"/\"default-dockercfg-qvsbl\""
Jul 15 20:18:37.049267 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.049193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a27bd5\"/\"test-model-a27bd5-kserve-self-signed-certs\""
Jul 15 20:18:37.058468 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.058448    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:18:37.140517 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.140698 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.140698 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.140698 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.140847 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjs8g\" (UniqueName: \"kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.140847 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.140788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.146887 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.146866    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:18:37.151589 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.151571    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:18:37.241709 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjs8g\" (UniqueName: \"kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.241709 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.241933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.241933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.241933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.241933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.241852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.242163 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.242143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.242226 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.242178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.242226 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.242207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.244209 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.244188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.244384 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.244365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.250968 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.250944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjs8g\" (UniqueName: \"kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g\") pod \"test-model-a27bd5-kserve-67db996c95-g8l48\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") " pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.355915 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.355829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:37.490068 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.490038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:18:37.493822 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:18:37.493794    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3299ff5_63c0_4993_ac71_80eecd7bc184.slice/crio-60d77f7ec3e4f9ff3012a77ba0a7259625412fc890301ab6970253670d700502 WatchSource:0}: Error finding container 60d77f7ec3e4f9ff3012a77ba0a7259625412fc890301ab6970253670d700502: Status 404 returned error can't find the container with id 60d77f7ec3e4f9ff3012a77ba0a7259625412fc890301ab6970253670d700502
Jul 15 20:18:37.550787 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:37.550762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" event={"ID":"e3299ff5-63c0-4993-ac71-80eecd7bc184","Type":"ContainerStarted","Data":"60d77f7ec3e4f9ff3012a77ba0a7259625412fc890301ab6970253670d700502"}
Jul 15 20:18:38.557341 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:38.557302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" event={"ID":"e3299ff5-63c0-4993-ac71-80eecd7bc184","Type":"ContainerStarted","Data":"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"}
Jul 15 20:18:38.576436 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:38.576391    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" podStartSLOduration=1.576374064 podStartE2EDuration="1.576374064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:18:38.574708925 +0000 UTC m=+2401.978089571" watchObservedRunningTime="2026-07-15 20:18:38.576374064 +0000 UTC m=+2401.979754729"
Jul 15 20:18:47.356126 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:47.356090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:47.356603 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:47.356140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:47.371715 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:47.371681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:18:47.612804 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:18:47.612724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:19:24.213632 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:24.213598    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:19:25.118607 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:25.118581    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:19:39.233999 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.233957    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" podUID="0ad60f68-7b42-4333-bad1-bd868af68f62" containerName="main" containerID="cri-o://a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627" gracePeriod=45
Jul 15 20:19:39.474312 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.474287    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:19:39.584159 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584385 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584385 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584235    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584385 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584385 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584385 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584363    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw8hd\" (UniqueName: \"kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd\") pod \"0ad60f68-7b42-4333-bad1-bd868af68f62\" (UID: \"0ad60f68-7b42-4333-bad1-bd868af68f62\") "
Jul 15 20:19:39.584658 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584409    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home" (OuterVolumeSpecName: "home") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:39.584658 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:39.584658 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584469    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:39.584775 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584668    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.584775 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584686    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.584775 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.584698    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.586619 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.586594    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:19:39.586771 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.586750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm" (OuterVolumeSpecName: "dshm") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:39.586822 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.586776    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd" (OuterVolumeSpecName: "kube-api-access-zw8hd") pod "0ad60f68-7b42-4333-bad1-bd868af68f62" (UID: "0ad60f68-7b42-4333-bad1-bd868af68f62"). InnerVolumeSpecName "kube-api-access-zw8hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:19:39.686031 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.686001    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ad60f68-7b42-4333-bad1-bd868af68f62-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.686031 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.686030    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ad60f68-7b42-4333-bad1-bd868af68f62-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.686192 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.686048    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw8hd\" (UniqueName: \"kubernetes.io/projected/0ad60f68-7b42-4333-bad1-bd868af68f62-kube-api-access-zw8hd\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:39.838293 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.838205    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ad60f68-7b42-4333-bad1-bd868af68f62" containerID="a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627" exitCode=0
Jul 15 20:19:39.838293 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.838244    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"
Jul 15 20:19:39.838454 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.838286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" event={"ID":"0ad60f68-7b42-4333-bad1-bd868af68f62","Type":"ContainerDied","Data":"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"}
Jul 15 20:19:39.838454 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.838326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz" event={"ID":"0ad60f68-7b42-4333-bad1-bd868af68f62","Type":"ContainerDied","Data":"3d12b70117b6858be1fc551ba80ec352e6ccbe06d8dc02d5ffa8a4715355bde6"}
Jul 15 20:19:39.838454 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.838343    2580 scope.go:117] "RemoveContainer" containerID="a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"
Jul 15 20:19:39.847542 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.847520    2580 scope.go:117] "RemoveContainer" containerID="a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"
Jul 15 20:19:39.847778 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:19:39.847763    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627\": container with ID starting with a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627 not found: ID does not exist" containerID="a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"
Jul 15 20:19:39.847831 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.847786    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627"} err="failed to get container status \"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627\": rpc error: code = NotFound desc = could not find container \"a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627\": container with ID starting with a80edd4087e5322d6c143ba48c5984e3e38bc03aa2bd33e0bf956bdb975b8627 not found: ID does not exist"
Jul 15 20:19:39.858904 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.858879    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:19:39.864834 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:39.864817    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c923f1/test-model-c923f1-kserve-7f8688f46f-grzpz"]
Jul 15 20:19:40.138610 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.138524    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" podUID="e3299ff5-63c0-4993-ac71-80eecd7bc184" containerName="main" containerID="cri-o://6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2" gracePeriod=45
Jul 15 20:19:40.388930 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.388881    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:19:40.492518 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492705 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492588    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492705 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492613    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492705 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492636    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492856 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492726    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492856 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjs8g\" (UniqueName: \"kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g\") pod \"e3299ff5-63c0-4993-ac71-80eecd7bc184\" (UID: \"e3299ff5-63c0-4993-ac71-80eecd7bc184\") "
Jul 15 20:19:40.492936 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492853    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache" (OuterVolumeSpecName: "model-cache") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:40.492936 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492890    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:40.493040 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.492993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home" (OuterVolumeSpecName: "home") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:40.493087 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.493040    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.493087 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.493053    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.501092 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.500855    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm" (OuterVolumeSpecName: "dshm") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:19:40.501232 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.501208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g" (OuterVolumeSpecName: "kube-api-access-kjs8g") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "kube-api-access-kjs8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:19:40.501310 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.501212    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e3299ff5-63c0-4993-ac71-80eecd7bc184" (UID: "e3299ff5-63c0-4993-ac71-80eecd7bc184"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:19:40.594064 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.594037    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.594064 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.594057    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3299ff5-63c0-4993-ac71-80eecd7bc184-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.594227 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.594084    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjs8g\" (UniqueName: \"kubernetes.io/projected/e3299ff5-63c0-4993-ac71-80eecd7bc184-kube-api-access-kjs8g\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.594227 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.594094    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3299ff5-63c0-4993-ac71-80eecd7bc184-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:19:40.845490 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.845454    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3299ff5-63c0-4993-ac71-80eecd7bc184" containerID="6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2" exitCode=0
Jul 15 20:19:40.845656 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.845530    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"
Jul 15 20:19:40.845656 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.845539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" event={"ID":"e3299ff5-63c0-4993-ac71-80eecd7bc184","Type":"ContainerDied","Data":"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"}
Jul 15 20:19:40.845656 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.845578    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48" event={"ID":"e3299ff5-63c0-4993-ac71-80eecd7bc184","Type":"ContainerDied","Data":"60d77f7ec3e4f9ff3012a77ba0a7259625412fc890301ab6970253670d700502"}
Jul 15 20:19:40.845656 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.845596    2580 scope.go:117] "RemoveContainer" containerID="6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"
Jul 15 20:19:40.854895 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.854878    2580 scope.go:117] "RemoveContainer" containerID="6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"
Jul 15 20:19:40.855178 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:19:40.855160    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2\": container with ID starting with 6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2 not found: ID does not exist" containerID="6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"
Jul 15 20:19:40.855234 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.855191    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2"} err="failed to get container status \"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2\": rpc error: code = NotFound desc = could not find container \"6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2\": container with ID starting with 6d48946a9ad4a518736f8231368ca87b9e80ce6db877ad7b5dcb5baf7a0072a2 not found: ID does not exist"
Jul 15 20:19:40.866868 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.866851    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:19:40.873531 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:40.873511    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a27bd5/test-model-a27bd5-kserve-67db996c95-g8l48"]
Jul 15 20:19:41.117604 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:41.117514    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ad60f68-7b42-4333-bad1-bd868af68f62" path="/var/lib/kubelet/pods/0ad60f68-7b42-4333-bad1-bd868af68f62/volumes"
Jul 15 20:19:41.117988 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:19:41.117968    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3299ff5-63c0-4993-ac71-80eecd7bc184" path="/var/lib/kubelet/pods/e3299ff5-63c0-4993-ac71-80eecd7bc184/volumes"
Jul 15 20:20:42.443645 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.443610    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"]
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.443941    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ad60f68-7b42-4333-bad1-bd868af68f62" containerName="main"
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.443952    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ad60f68-7b42-4333-bad1-bd868af68f62" containerName="main"
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.443964    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3299ff5-63c0-4993-ac71-80eecd7bc184" containerName="main"
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.443970    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3299ff5-63c0-4993-ac71-80eecd7bc184" containerName="main"
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.444021    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3299ff5-63c0-4993-ac71-80eecd7bc184" containerName="main"
Jul 15 20:20:42.444036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.444029    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ad60f68-7b42-4333-bad1-bd868af68f62" containerName="main"
Jul 15 20:20:42.448300 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.448284    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:42.450794 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.450763    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkj8f\""
Jul 15 20:20:42.450934 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.450919    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 20:20:42.455366 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.455247    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"]
Jul 15 20:20:42.519805 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.519777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq\" (UID: \"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:42.620263 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.620232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq\" (UID: \"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:42.620829 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.620811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq\" (UID: \"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:42.758755 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.758730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:42.899601 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.899577    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"]
Jul 15 20:20:42.902589 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:20:42.902550    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae789b1_af95_4480_a2f7_91d0bd1e5bdb.slice/crio-4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f WatchSource:0}: Error finding container 4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f: Status 404 returned error can't find the container with id 4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f
Jul 15 20:20:42.904665 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:42.904649    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:20:43.117471 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:43.117396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq" event={"ID":"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb","Type":"ContainerStarted","Data":"4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f"}
Jul 15 20:20:46.135777 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:46.135744    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ae789b1-af95-4480-a2f7-91d0bd1e5bdb" containerID="1b5acd941f2ef0cc183aaf544895448001aaa68b43b7bb0f33e857f2f0a208e9" exitCode=0
Jul 15 20:20:46.136144 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:46.135811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq" event={"ID":"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb","Type":"ContainerDied","Data":"1b5acd941f2ef0cc183aaf544895448001aaa68b43b7bb0f33e857f2f0a208e9"}
Jul 15 20:20:47.270009 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:47.269986    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:47.365529 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:47.365462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca\") pod \"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb\" (UID: \"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb\") "
Jul 15 20:20:47.365837 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:47.365813    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ae789b1-af95-4480-a2f7-91d0bd1e5bdb" (UID: "0ae789b1-af95-4480-a2f7-91d0bd1e5bdb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:20:47.466170 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:47.466086    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ae789b1-af95-4480-a2f7-91d0bd1e5bdb-maas-api-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:20:48.145936 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:48.145902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq" event={"ID":"0ae789b1-af95-4480-a2f7-91d0bd1e5bdb","Type":"ContainerDied","Data":"4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f"}
Jul 15 20:20:48.145936 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:48.145930    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq"
Jul 15 20:20:48.146130 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:20:48.145949    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c4081a15ea7192bd16c7f65fdd8e2e77924e7e7b40f7e9efd2c9bf2350c758f"
Jul 15 20:22:01.125416 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.125341    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:22:01.125933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.125695    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae789b1-af95-4480-a2f7-91d0bd1e5bdb" containerName="revoke-keys"
Jul 15 20:22:01.125933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.125707    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae789b1-af95-4480-a2f7-91d0bd1e5bdb" containerName="revoke-keys"
Jul 15 20:22:01.125933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.125791    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae789b1-af95-4480-a2f7-91d0bd1e5bdb" containerName="revoke-keys"
Jul 15 20:22:01.127733 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.127715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.130845 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.130824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"kube-root-ca.crt\""
Jul 15 20:22:01.130965 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.130860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"auth-test-model-3ada3b-kserve-self-signed-certs\""
Jul 15 20:22:01.130965 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.130909    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"default-dockercfg-f6mtf\""
Jul 15 20:22:01.130965 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.130826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"openshift-service-ca.crt\""
Jul 15 20:22:01.142152 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.142128    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:22:01.313304 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.313304 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.313565 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.313565 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z25f5\" (UniqueName: \"kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.313565 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.313565 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.313430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414544 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414544 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414779 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414779 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414779 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414779 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z25f5\" (UniqueName: \"kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.414984 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.414938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.415048 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.415019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.415101 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.415058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.416881 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.416860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.417268 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.417248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.423083 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.423063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z25f5\" (UniqueName: \"kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5\") pod \"auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") " pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.437084 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.437058    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:01.577866 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:01.577831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:22:01.581124 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:22:01.581101    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod627e8020_ac35_454c_a014_568a26213c0e.slice/crio-270fa925f467bb85dc76586c23f873b3d124ff0082196792fc60decd32f4be14 WatchSource:0}: Error finding container 270fa925f467bb85dc76586c23f873b3d124ff0082196792fc60decd32f4be14: Status 404 returned error can't find the container with id 270fa925f467bb85dc76586c23f873b3d124ff0082196792fc60decd32f4be14
Jul 15 20:22:02.482777 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:02.482733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" event={"ID":"627e8020-ac35-454c-a014-568a26213c0e","Type":"ContainerStarted","Data":"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"}
Jul 15 20:22:02.483267 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:02.482793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" event={"ID":"627e8020-ac35-454c-a014-568a26213c0e","Type":"ContainerStarted","Data":"270fa925f467bb85dc76586c23f873b3d124ff0082196792fc60decd32f4be14"}
Jul 15 20:22:02.502490 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:02.502422    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" podStartSLOduration=1.502402774 podStartE2EDuration="1.502402774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:22:02.49998336 +0000 UTC m=+2605.903364000" watchObservedRunningTime="2026-07-15 20:22:02.502402774 +0000 UTC m=+2605.905783411"
Jul 15 20:22:11.437237 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:11.437204    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:11.437662 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:11.437250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:11.449389 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:11.449367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:22:11.538929 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:22:11.538905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:23:37.172492 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:23:37.172403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:23:37.178193 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:23:37.178170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:24:22.712472 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:22.712440    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:24:37.732551 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:37.732497    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" podUID="627e8020-ac35-454c-a014-568a26213c0e" containerName="main" containerID="cri-o://46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9" gracePeriod=45
Jul 15 20:24:37.977466 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:37.977437    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:24:38.115524 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.115688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115540    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.115688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z25f5\" (UniqueName: \"kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.115688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115668    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.115795 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.115795 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home\") pod \"627e8020-ac35-454c-a014-568a26213c0e\" (UID: \"627e8020-ac35-454c-a014-568a26213c0e\") "
Jul 15 20:24:38.116003 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.116097 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.115981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.116097 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.116045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home" (OuterVolumeSpecName: "home") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.117957 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.117936    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5" (OuterVolumeSpecName: "kube-api-access-z25f5") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "kube-api-access-z25f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:24:38.117957 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.117947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:24:38.118064 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.117998    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm" (OuterVolumeSpecName: "dshm") pod "627e8020-ac35-454c-a014-568a26213c0e" (UID: "627e8020-ac35-454c-a014-568a26213c0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.179380 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.179347    2580 generic.go:356] "Generic (PLEG): container finished" podID="627e8020-ac35-454c-a014-568a26213c0e" containerID="46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9" exitCode=0
Jul 15 20:24:38.179503 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.179384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" event={"ID":"627e8020-ac35-454c-a014-568a26213c0e","Type":"ContainerDied","Data":"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"}
Jul 15 20:24:38.179503 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.179425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p" event={"ID":"627e8020-ac35-454c-a014-568a26213c0e","Type":"ContainerDied","Data":"270fa925f467bb85dc76586c23f873b3d124ff0082196792fc60decd32f4be14"}
Jul 15 20:24:38.179503 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.179443    2580 scope.go:117] "RemoveContainer" containerID="46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"
Jul 15 20:24:38.179503 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.179394    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"
Jul 15 20:24:38.188050 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.188034    2580 scope.go:117] "RemoveContainer" containerID="46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"
Jul 15 20:24:38.188284 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:24:38.188268    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9\": container with ID starting with 46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9 not found: ID does not exist" containerID="46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"
Jul 15 20:24:38.188346 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.188292    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9"} err="failed to get container status \"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9\": rpc error: code = NotFound desc = could not find container \"46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9\": container with ID starting with 46c9e7e8f485bce42a89d506f8b065f6aa372c2394dbc7039757b539033cbae9 not found: ID does not exist"
Jul 15 20:24:38.200491 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.200453    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:24:38.204692 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.204667    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/auth-test-model-3ada3b-kserve-c6c6d45f5-m4c8p"]
Jul 15 20:24:38.217315 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217296    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.217315 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217313    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.217414 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217322    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.217414 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217331    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/627e8020-ac35-454c-a014-568a26213c0e-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.217414 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217339    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z25f5\" (UniqueName: \"kubernetes.io/projected/627e8020-ac35-454c-a014-568a26213c0e-kube-api-access-z25f5\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.217414 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:38.217358    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/627e8020-ac35-454c-a014-568a26213c0e-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:24:39.117590 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.117553    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="627e8020-ac35-454c-a014-568a26213c0e" path="/var/lib/kubelet/pods/627e8020-ac35-454c-a014-568a26213c0e/volumes"
Jul 15 20:24:39.368083 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.367992    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:24:39.368515 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.368496    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627e8020-ac35-454c-a014-568a26213c0e" containerName="main"
Jul 15 20:24:39.368583 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.368519    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="627e8020-ac35-454c-a014-568a26213c0e" containerName="main"
Jul 15 20:24:39.368635 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.368624    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="627e8020-ac35-454c-a014-568a26213c0e" containerName="main"
Jul 15 20:24:39.373346 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.373327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.376948 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.376910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"sub-test-model-3ada3b-kserve-self-signed-certs\""
Jul 15 20:24:39.376948 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.376920    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"kube-root-ca.crt\""
Jul 15 20:24:39.376948 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.376945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"openshift-service-ca.crt\""
Jul 15 20:24:39.377179 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.376927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"default-dockercfg-f6mtf\""
Jul 15 20:24:39.391577 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.391557    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:24:39.531019 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.530992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.531019 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.531024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.531253 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.531064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrwcj\" (UniqueName: \"kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.531253 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.531138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.531253 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.531161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.531253 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.531206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.631833 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.631833 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632037 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632037 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632037 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632037 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.631960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrwcj\" (UniqueName: \"kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632248 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.632210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632308 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.632258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.632359 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.632342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.634199 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.634171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.634417 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.634398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.642113 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.642084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrwcj\" (UniqueName: \"kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj\") pod \"sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") " pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.683082 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.683043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:39.819956 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:39.819926    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:24:39.822851 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:24:39.822824    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6a049f8_e40c_486f_880d_75436fcf6aa1.slice/crio-acd9e28aaa79f6b259d7a874447df4b87fd9dc24a35b0c13a3b9eb6c4262e378 WatchSource:0}: Error finding container acd9e28aaa79f6b259d7a874447df4b87fd9dc24a35b0c13a3b9eb6c4262e378: Status 404 returned error can't find the container with id acd9e28aaa79f6b259d7a874447df4b87fd9dc24a35b0c13a3b9eb6c4262e378
Jul 15 20:24:40.191192 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:40.191106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" event={"ID":"a6a049f8-e40c-486f-880d-75436fcf6aa1","Type":"ContainerStarted","Data":"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"}
Jul 15 20:24:40.191192 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:40.191152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" event={"ID":"a6a049f8-e40c-486f-880d-75436fcf6aa1","Type":"ContainerStarted","Data":"acd9e28aaa79f6b259d7a874447df4b87fd9dc24a35b0c13a3b9eb6c4262e378"}
Jul 15 20:24:40.210036 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:40.209990    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" podStartSLOduration=1.2099750710000001 podStartE2EDuration="1.209975071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:24:40.208633974 +0000 UTC m=+2763.612014603" watchObservedRunningTime="2026-07-15 20:24:40.209975071 +0000 UTC m=+2763.613355706"
Jul 15 20:24:49.684196 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:49.684147    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:49.684659 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:49.684213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:49.697427 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:49.697397    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:24:50.247113 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:24:50.247087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:25:02.327111 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.327027    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:25:02.330020 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.330005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.332493 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.332458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"default-dockercfg-6c28d\""
Jul 15 20:25:02.332611 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.332593    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"kube-root-ca.crt\""
Jul 15 20:25:02.332667 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.332658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"openshift-service-ca.crt\""
Jul 15 20:25:02.333374 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.333355    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"sub-test-model-54098e-kserve-self-signed-certs\""
Jul 15 20:25:02.339295 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.339271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:25:02.431463 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.431463 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-975mv\" (UniqueName: \"kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.431688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.431688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.431688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.431688 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.431646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532289 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532456 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532456 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-975mv\" (UniqueName: \"kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532456 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532456 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532456 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532743 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532743 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.532856 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.532776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.534818 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.534787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.534918 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.534905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.540810 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.540788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-975mv\" (UniqueName: \"kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv\") pod \"sub-test-model-54098e-kserve-8c45f59b5-snqsr\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") " pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.640643 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.640559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:02.784106 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:02.784083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:25:02.786645 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:25:02.786613    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c216745_aa22_4061_960d_df49b9a8cdd5.slice/crio-242551efcdc289ffd3839a69676afac2ed0962a4e978f52def302778d4ae5538 WatchSource:0}: Error finding container 242551efcdc289ffd3839a69676afac2ed0962a4e978f52def302778d4ae5538: Status 404 returned error can't find the container with id 242551efcdc289ffd3839a69676afac2ed0962a4e978f52def302778d4ae5538
Jul 15 20:25:03.295816 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:03.295776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" event={"ID":"3c216745-aa22-4061-960d-df49b9a8cdd5","Type":"ContainerStarted","Data":"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"}
Jul 15 20:25:03.295968 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:03.295825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" event={"ID":"3c216745-aa22-4061-960d-df49b9a8cdd5","Type":"ContainerStarted","Data":"242551efcdc289ffd3839a69676afac2ed0962a4e978f52def302778d4ae5538"}
Jul 15 20:25:03.315342 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:03.315291    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" podStartSLOduration=1.315277467 podStartE2EDuration="1.315277467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:25:03.314077733 +0000 UTC m=+2786.717458370" watchObservedRunningTime="2026-07-15 20:25:03.315277467 +0000 UTC m=+2786.718658137"
Jul 15 20:25:12.640992 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:12.640962    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:12.641521 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:12.641014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:12.653334 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:12.653309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:13.352160 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:13.352131    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:25:45.935720 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:45.935687    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:25:46.705388 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:25:46.705354    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:26:00.955403 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:00.955363    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" podUID="a6a049f8-e40c-486f-880d-75436fcf6aa1" containerName="main" containerID="cri-o://bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37" gracePeriod=45
Jul 15 20:26:01.209228 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.209176    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:26:01.250227 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250207    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250357 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250258    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250357 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250357 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrwcj\" (UniqueName: \"kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250534 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250592 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250547    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir\") pod \"a6a049f8-e40c-486f-880d-75436fcf6aa1\" (UID: \"a6a049f8-e40c-486f-880d-75436fcf6aa1\") "
Jul 15 20:26:01.250644 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250592    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:01.250723 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home" (OuterVolumeSpecName: "home") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:01.250889 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.250859    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:01.251149 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.251132    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.251215 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.251154    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.251215 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.251168    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.252560 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.252536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:26:01.252560 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.252548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm" (OuterVolumeSpecName: "dshm") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:01.252946 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.252931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj" (OuterVolumeSpecName: "kube-api-access-vrwcj") pod "a6a049f8-e40c-486f-880d-75436fcf6aa1" (UID: "a6a049f8-e40c-486f-880d-75436fcf6aa1"). InnerVolumeSpecName "kube-api-access-vrwcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:26:01.352528 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.352503    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6a049f8-e40c-486f-880d-75436fcf6aa1-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.352528 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.352526    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6a049f8-e40c-486f-880d-75436fcf6aa1-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.352661 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.352537    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrwcj\" (UniqueName: \"kubernetes.io/projected/a6a049f8-e40c-486f-880d-75436fcf6aa1-kube-api-access-vrwcj\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:01.560799 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.560765    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6a049f8-e40c-486f-880d-75436fcf6aa1" containerID="bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37" exitCode=0
Jul 15 20:26:01.560981 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.560811    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"
Jul 15 20:26:01.560981 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.560851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" event={"ID":"a6a049f8-e40c-486f-880d-75436fcf6aa1","Type":"ContainerDied","Data":"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"}
Jul 15 20:26:01.560981 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.560893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg" event={"ID":"a6a049f8-e40c-486f-880d-75436fcf6aa1","Type":"ContainerDied","Data":"acd9e28aaa79f6b259d7a874447df4b87fd9dc24a35b0c13a3b9eb6c4262e378"}
Jul 15 20:26:01.560981 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.560913    2580 scope.go:117] "RemoveContainer" containerID="bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"
Jul 15 20:26:01.570698 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.570682    2580 scope.go:117] "RemoveContainer" containerID="bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"
Jul 15 20:26:01.571019 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:26:01.570984    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37\": container with ID starting with bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37 not found: ID does not exist" containerID="bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"
Jul 15 20:26:01.571149 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.571028    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37"} err="failed to get container status \"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37\": rpc error: code = NotFound desc = could not find container \"bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37\": container with ID starting with bab4372779b6d3456549752047d32b976255c4b96418e4cadddec2aa6285dc37 not found: ID does not exist"
Jul 15 20:26:01.587399 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.587381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:26:01.590902 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.590884    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/sub-test-model-3ada3b-kserve-56fd466b7f-4v4qg"]
Jul 15 20:26:01.728188 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.728132    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" podUID="3c216745-aa22-4061-960d-df49b9a8cdd5" containerName="main" containerID="cri-o://556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87" gracePeriod=45
Jul 15 20:26:01.991257 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:01.991232    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:26:02.058211 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058189    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058211 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058405 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058249    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058405 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058405 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-975mv\" (UniqueName: \"kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058405 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058377    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home\") pod \"3c216745-aa22-4061-960d-df49b9a8cdd5\" (UID: \"3c216745-aa22-4061-960d-df49b9a8cdd5\") "
Jul 15 20:26:02.058639 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:02.058639 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058561    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:02.058835 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058787    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.058835 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058815    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.059196 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.058889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home" (OuterVolumeSpecName: "home") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:02.060732 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.060710    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv" (OuterVolumeSpecName: "kube-api-access-975mv") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "kube-api-access-975mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:26:02.060732 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.060724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm" (OuterVolumeSpecName: "dshm") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:26:02.060855 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.060734    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c216745-aa22-4061-960d-df49b9a8cdd5" (UID: "3c216745-aa22-4061-960d-df49b9a8cdd5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:26:02.159448 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.159391    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.159448 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.159412    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c216745-aa22-4061-960d-df49b9a8cdd5-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.159448 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.159420    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c216745-aa22-4061-960d-df49b9a8cdd5-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.159448 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.159428    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-975mv\" (UniqueName: \"kubernetes.io/projected/3c216745-aa22-4061-960d-df49b9a8cdd5-kube-api-access-975mv\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:26:02.566289 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.566256    2580 generic.go:356] "Generic (PLEG): container finished" podID="3c216745-aa22-4061-960d-df49b9a8cdd5" containerID="556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87" exitCode=0
Jul 15 20:26:02.566446 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.566291    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"
Jul 15 20:26:02.566446 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.566346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" event={"ID":"3c216745-aa22-4061-960d-df49b9a8cdd5","Type":"ContainerDied","Data":"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"}
Jul 15 20:26:02.566446 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.566390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr" event={"ID":"3c216745-aa22-4061-960d-df49b9a8cdd5","Type":"ContainerDied","Data":"242551efcdc289ffd3839a69676afac2ed0962a4e978f52def302778d4ae5538"}
Jul 15 20:26:02.566446 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.566413    2580 scope.go:117] "RemoveContainer" containerID="556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"
Jul 15 20:26:02.577503 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.577452    2580 scope.go:117] "RemoveContainer" containerID="556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"
Jul 15 20:26:02.577760 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:26:02.577742    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87\": container with ID starting with 556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87 not found: ID does not exist" containerID="556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"
Jul 15 20:26:02.577826 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.577769    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87"} err="failed to get container status \"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87\": rpc error: code = NotFound desc = could not find container \"556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87\": container with ID starting with 556462f8aacfd7f3f65c69c74aeddaa984f823c7eb24042c826f41cd2278ce87 not found: ID does not exist"
Jul 15 20:26:02.589697 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.589677    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:26:02.593622 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:02.593603    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/sub-test-model-54098e-kserve-8c45f59b5-snqsr"]
Jul 15 20:26:03.117725 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:03.117696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c216745-aa22-4061-960d-df49b9a8cdd5" path="/var/lib/kubelet/pods/3c216745-aa22-4061-960d-df49b9a8cdd5/volumes"
Jul 15 20:26:03.118098 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:03.118072    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a049f8-e40c-486f-880d-75436fcf6aa1" path="/var/lib/kubelet/pods/a6a049f8-e40c-486f-880d-75436fcf6aa1/volumes"
Jul 15 20:26:20.576326 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576294    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576660    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a049f8-e40c-486f-880d-75436fcf6aa1" containerName="main"
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576672    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a049f8-e40c-486f-880d-75436fcf6aa1" containerName="main"
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576685    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c216745-aa22-4061-960d-df49b9a8cdd5" containerName="main"
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576690    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c216745-aa22-4061-960d-df49b9a8cdd5" containerName="main"
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576774    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a049f8-e40c-486f-880d-75436fcf6aa1" containerName="main"
Jul 15 20:26:20.578370 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.576780    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c216745-aa22-4061-960d-df49b9a8cdd5" containerName="main"
Jul 15 20:26:20.579548 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.579534    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.582096 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.582073    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"kube-root-ca.crt\""
Jul 15 20:26:20.582863 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.582841    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"openshift-service-ca.crt\""
Jul 15 20:26:20.582967 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.582908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"default-dockercfg-6c28d\""
Jul 15 20:26:20.582967 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.582926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"rate-test-model-54098e-kserve-self-signed-certs\""
Jul 15 20:26:20.589336 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.589308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:26:20.723750 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.723750 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgstl\" (UniqueName: \"kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.723962 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.723962 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.723962 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.723962 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.723940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.824957 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.824921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.824957 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.824959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgstl\" (UniqueName: \"kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825204 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.824991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825204 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825204 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825204 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825444 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825547 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.825547 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.825501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.827534 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.827452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.827736 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.827719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.834603 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.834580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgstl\" (UniqueName: \"kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl\") pod \"rate-test-model-54098e-kserve-5575d55687-slg66\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") " pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:20.889637 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:20.889604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:21.028291 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:21.028265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:26:21.030634 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:26:21.030607    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf6dccca_483e_49e5_ba53_f1a72664447a.slice/crio-62d8839d1ef92f644f8b849ecc33c0d33721bf2edf7f3088b66c24e094ef9f24 WatchSource:0}: Error finding container 62d8839d1ef92f644f8b849ecc33c0d33721bf2edf7f3088b66c24e094ef9f24: Status 404 returned error can't find the container with id 62d8839d1ef92f644f8b849ecc33c0d33721bf2edf7f3088b66c24e094ef9f24
Jul 15 20:26:21.655781 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:21.655748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" event={"ID":"cf6dccca-483e-49e5-ba53-f1a72664447a","Type":"ContainerStarted","Data":"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"}
Jul 15 20:26:21.655781 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:21.655785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" event={"ID":"cf6dccca-483e-49e5-ba53-f1a72664447a","Type":"ContainerStarted","Data":"62d8839d1ef92f644f8b849ecc33c0d33721bf2edf7f3088b66c24e094ef9f24"}
Jul 15 20:26:21.676774 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:21.676725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" podStartSLOduration=1.676709556 podStartE2EDuration="1.676709556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:26:21.675353441 +0000 UTC m=+2865.078734087" watchObservedRunningTime="2026-07-15 20:26:21.676709556 +0000 UTC m=+2865.080090238"
Jul 15 20:26:30.890780 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:30.890692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:30.891344 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:30.891000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:30.904313 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:30.904275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:26:31.712997 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:26:31.712970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:27:06.856588 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:06.856560    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:27:07.795625 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:07.795597    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731710512"]
Jul 15 20:27:07.798754 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:07.798739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:07.803653 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:07.803635    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djtgp\""
Jul 15 20:27:07.808740 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:07.808642    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731710512"]
Jul 15 20:27:07.938678 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:07.938651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvnp\" (UniqueName: \"kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp\") pod \"test-curl-7443-140511731710512\" (UID: \"f944ef7d-f361-406d-8faa-74bcb40f336d\") " pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:08.039533 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.039494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvnp\" (UniqueName: \"kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp\") pod \"test-curl-7443-140511731710512\" (UID: \"f944ef7d-f361-406d-8faa-74bcb40f336d\") " pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:08.049098 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.049033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvnp\" (UniqueName: \"kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp\") pod \"test-curl-7443-140511731710512\" (UID: \"f944ef7d-f361-406d-8faa-74bcb40f336d\") " pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:08.108501 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.108464    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:08.240671 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.240646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731710512"]
Jul 15 20:27:08.242709 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:08.242679    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf944ef7d_f361_406d_8faa_74bcb40f336d.slice/crio-4ba67e93088c2dbed4ad1332079533120f2195b1cdc56ea9a39d81e811d0b85f WatchSource:0}: Error finding container 4ba67e93088c2dbed4ad1332079533120f2195b1cdc56ea9a39d81e811d0b85f: Status 404 returned error can't find the container with id 4ba67e93088c2dbed4ad1332079533120f2195b1cdc56ea9a39d81e811d0b85f
Jul 15 20:27:08.244283 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.244264    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:27:08.868887 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:08.868851    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731710512" event={"ID":"f944ef7d-f361-406d-8faa-74bcb40f336d","Type":"ContainerStarted","Data":"4ba67e93088c2dbed4ad1332079533120f2195b1cdc56ea9a39d81e811d0b85f"}
Jul 15 20:27:09.875401 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:09.875364    2580 generic.go:356] "Generic (PLEG): container finished" podID="f944ef7d-f361-406d-8faa-74bcb40f336d" containerID="72c5a0fb72526b665248970e61a61acdc3e8145aeee7fdb63a6e9a1221d38e42" exitCode=0
Jul 15 20:27:09.875785 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:09.875448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731710512" event={"ID":"f944ef7d-f361-406d-8faa-74bcb40f336d","Type":"ContainerDied","Data":"72c5a0fb72526b665248970e61a61acdc3e8145aeee7fdb63a6e9a1221d38e42"}
Jul 15 20:27:11.011424 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.011389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:11.047509 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.047465    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731710512_f944ef7d-f361-406d-8faa-74bcb40f336d/test-curl-7443-140511731710512/0.log"
Jul 15 20:27:11.073021 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.072995    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731710512"]
Jul 15 20:27:11.076058 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.076034    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731710512"]
Jul 15 20:27:11.168911 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.168851    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qvnp\" (UniqueName: \"kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp\") pod \"f944ef7d-f361-406d-8faa-74bcb40f336d\" (UID: \"f944ef7d-f361-406d-8faa-74bcb40f336d\") "
Jul 15 20:27:11.171248 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.171224    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp" (OuterVolumeSpecName: "kube-api-access-6qvnp") pod "f944ef7d-f361-406d-8faa-74bcb40f336d" (UID: "f944ef7d-f361-406d-8faa-74bcb40f336d"). InnerVolumeSpecName "kube-api-access-6qvnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:11.209673 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.209650    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731709872"]
Jul 15 20:27:11.209969 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.209958    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f944ef7d-f361-406d-8faa-74bcb40f336d" containerName="test-curl-7443-140511731710512"
Jul 15 20:27:11.210014 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.209971    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f944ef7d-f361-406d-8faa-74bcb40f336d" containerName="test-curl-7443-140511731710512"
Jul 15 20:27:11.210044 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.210022    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f944ef7d-f361-406d-8faa-74bcb40f336d" containerName="test-curl-7443-140511731710512"
Jul 15 20:27:11.212873 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.212858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:11.219843 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.219821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731709872"]
Jul 15 20:27:11.269587 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.269556    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qvnp\" (UniqueName: \"kubernetes.io/projected/f944ef7d-f361-406d-8faa-74bcb40f336d-kube-api-access-6qvnp\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:11.370819 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.370787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqnj5\" (UniqueName: \"kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5\") pod \"test-curl-7443-140511731709872\" (UID: \"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f\") " pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:11.471843 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.471762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqnj5\" (UniqueName: \"kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5\") pod \"test-curl-7443-140511731709872\" (UID: \"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f\") " pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:11.481070 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.481041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqnj5\" (UniqueName: \"kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5\") pod \"test-curl-7443-140511731709872\" (UID: \"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f\") " pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:11.522075 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.522052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:11.654841 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.654818    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731709872"]
Jul 15 20:27:11.656922 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:11.656896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffe625ab_3795_4fbd_9dc8_0a8cd21dea6f.slice/crio-62903bd283a0f106bdb930f968b06de8245d27c1003eda48844cac207993caee WatchSource:0}: Error finding container 62903bd283a0f106bdb930f968b06de8245d27c1003eda48844cac207993caee: Status 404 returned error can't find the container with id 62903bd283a0f106bdb930f968b06de8245d27c1003eda48844cac207993caee
Jul 15 20:27:11.885933 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.885903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731710512"
Jul 15 20:27:11.886099 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.885958    2580 scope.go:117] "RemoveContainer" containerID="72c5a0fb72526b665248970e61a61acdc3e8145aeee7fdb63a6e9a1221d38e42"
Jul 15 20:27:11.887254 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:11.887147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731709872" event={"ID":"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f","Type":"ContainerStarted","Data":"62903bd283a0f106bdb930f968b06de8245d27c1003eda48844cac207993caee"}
Jul 15 20:27:12.893092 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:12.893059    2580 generic.go:356] "Generic (PLEG): container finished" podID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" containerID="672ca2b4dac459395fdca1d84612b1e818d43e6b7616be58737a41187ac6fca2" exitCode=0
Jul 15 20:27:12.893505 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:12.893147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731709872" event={"ID":"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f","Type":"ContainerDied","Data":"672ca2b4dac459395fdca1d84612b1e818d43e6b7616be58737a41187ac6fca2"}
Jul 15 20:27:13.117517 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:13.117464    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f944ef7d-f361-406d-8faa-74bcb40f336d" path="/var/lib/kubelet/pods/f944ef7d-f361-406d-8faa-74bcb40f336d/volumes"
Jul 15 20:27:14.027243 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.027220    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:14.055069 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.055047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731709872_ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f/test-curl-7443-140511731709872/0.log"
Jul 15 20:27:14.079901 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.079875    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731709872"]
Jul 15 20:27:14.088357 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.088333    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731709872"]
Jul 15 20:27:14.194153 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.194088    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqnj5\" (UniqueName: \"kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5\") pod \"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f\" (UID: \"ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f\") "
Jul 15 20:27:14.196212 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.196188    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5" (OuterVolumeSpecName: "kube-api-access-tqnj5") pod "ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" (UID: "ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f"). InnerVolumeSpecName "kube-api-access-tqnj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:14.241807 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.241782    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:14.242121 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.242110    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" containerName="test-curl-7443-140511731709872"
Jul 15 20:27:14.242157 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.242123    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" containerName="test-curl-7443-140511731709872"
Jul 15 20:27:14.242209 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.242200    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" containerName="test-curl-7443-140511731709872"
Jul 15 20:27:14.244989 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.244973    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:14.250409 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.250373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:14.295199 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.295169    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqnj5\" (UniqueName: \"kubernetes.io/projected/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f-kube-api-access-tqnj5\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:14.396206 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.396175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxsk\" (UniqueName: \"kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk\") pod \"test-curl-7443-140511731556400\" (UID: \"9b5a2ce3-07b8-4e97-9f75-f538d319c390\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:14.496740 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.496717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxsk\" (UniqueName: \"kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk\") pod \"test-curl-7443-140511731556400\" (UID: \"9b5a2ce3-07b8-4e97-9f75-f538d319c390\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:14.504979 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.504947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxsk\" (UniqueName: \"kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk\") pod \"test-curl-7443-140511731556400\" (UID: \"9b5a2ce3-07b8-4e97-9f75-f538d319c390\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:14.554636 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.554611    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:14.692757 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.692735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:14.692757 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:14.692743    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b5a2ce3_07b8_4e97_9f75_f538d319c390.slice/crio-a11ce7258296529d4d19b4931bc89fcc01b64b1cd92fc49b5f01050288251c01 WatchSource:0}: Error finding container a11ce7258296529d4d19b4931bc89fcc01b64b1cd92fc49b5f01050288251c01: Status 404 returned error can't find the container with id a11ce7258296529d4d19b4931bc89fcc01b64b1cd92fc49b5f01050288251c01
Jul 15 20:27:14.904423 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.904342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:14.904423 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.904381    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62903bd283a0f106bdb930f968b06de8245d27c1003eda48844cac207993caee"
Jul 15 20:27:14.905533 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:14.905509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731556400" event={"ID":"9b5a2ce3-07b8-4e97-9f75-f538d319c390","Type":"ContainerStarted","Data":"a11ce7258296529d4d19b4931bc89fcc01b64b1cd92fc49b5f01050288251c01"}
Jul 15 20:27:14.914506 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:27:14.914464    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7443-140511731709872\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" pod="opendatahub/test-curl-7443-140511731709872"
Jul 15 20:27:15.116996 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:15.116973    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f" path="/var/lib/kubelet/pods/ffe625ab-3795-4fbd-9dc8-0a8cd21dea6f/volumes"
Jul 15 20:27:15.911272 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:15.911236    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b5a2ce3-07b8-4e97-9f75-f538d319c390" containerID="9af4d953c77a44be7706c5a50ff53a3d2d2200410e10770cc5105f201d755deb" exitCode=0
Jul 15 20:27:15.911446 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:15.911291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731556400" event={"ID":"9b5a2ce3-07b8-4e97-9f75-f538d319c390","Type":"ContainerDied","Data":"9af4d953c77a44be7706c5a50ff53a3d2d2200410e10770cc5105f201d755deb"}
Jul 15 20:27:17.041102 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.041080    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.069665 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.069643    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731556400_9b5a2ce3-07b8-4e97-9f75-f538d319c390/test-curl-7443-140511731556400/0.log"
Jul 15 20:27:17.093230 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.093204    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:17.098249 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.098224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:17.117028 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.117006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxsk\" (UniqueName: \"kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk\") pod \"9b5a2ce3-07b8-4e97-9f75-f538d319c390\" (UID: \"9b5a2ce3-07b8-4e97-9f75-f538d319c390\") "
Jul 15 20:27:17.119269 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.119239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk" (OuterVolumeSpecName: "kube-api-access-2cxsk") pod "9b5a2ce3-07b8-4e97-9f75-f538d319c390" (UID: "9b5a2ce3-07b8-4e97-9f75-f538d319c390"). InnerVolumeSpecName "kube-api-access-2cxsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:17.218556 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.218452    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxsk\" (UniqueName: \"kubernetes.io/projected/9b5a2ce3-07b8-4e97-9f75-f538d319c390-kube-api-access-2cxsk\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:17.232934 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.232903    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:17.233261 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.233248    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b5a2ce3-07b8-4e97-9f75-f538d319c390" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:17.233296 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.233263    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b5a2ce3-07b8-4e97-9f75-f538d319c390" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:17.233342 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.233317    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b5a2ce3-07b8-4e97-9f75-f538d319c390" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:17.236101 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.236086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.256609 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.256583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:17.319740 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.319703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2kl8\" (UniqueName: \"kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8\") pod \"test-curl-7443-140511731556400\" (UID: \"5f8e8920-58df-496b-a998-72f84583b38b\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.420264 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.420224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2kl8\" (UniqueName: \"kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8\") pod \"test-curl-7443-140511731556400\" (UID: \"5f8e8920-58df-496b-a998-72f84583b38b\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.431450 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.431419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2kl8\" (UniqueName: \"kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8\") pod \"test-curl-7443-140511731556400\" (UID: \"5f8e8920-58df-496b-a998-72f84583b38b\") " pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.544779 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.544751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.693967 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.693934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:17.695412 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:17.695386    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f8e8920_58df_496b_a998_72f84583b38b.slice/crio-10698287d55043704c5193d937bc9bf34e56942552499a0f3832c6bad0f568d0 WatchSource:0}: Error finding container 10698287d55043704c5193d937bc9bf34e56942552499a0f3832c6bad0f568d0: Status 404 returned error can't find the container with id 10698287d55043704c5193d937bc9bf34e56942552499a0f3832c6bad0f568d0
Jul 15 20:27:17.921192 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.921103    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:17.921192 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.921100    2580 scope.go:117] "RemoveContainer" containerID="9af4d953c77a44be7706c5a50ff53a3d2d2200410e10770cc5105f201d755deb"
Jul 15 20:27:17.922428 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:17.922285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731556400" event={"ID":"5f8e8920-58df-496b-a998-72f84583b38b","Type":"ContainerStarted","Data":"10698287d55043704c5193d937bc9bf34e56942552499a0f3832c6bad0f568d0"}
Jul 15 20:27:18.929088 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:18.929055    2580 generic.go:356] "Generic (PLEG): container finished" podID="5f8e8920-58df-496b-a998-72f84583b38b" containerID="954fd7856b2104219191e1667723a03a0f3e369c57c23a0da94e0f14c496971a" exitCode=0
Jul 15 20:27:18.929470 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:18.929144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731556400" event={"ID":"5f8e8920-58df-496b-a998-72f84583b38b","Type":"ContainerDied","Data":"954fd7856b2104219191e1667723a03a0f3e369c57c23a0da94e0f14c496971a"}
Jul 15 20:27:19.118647 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:19.118614    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b5a2ce3-07b8-4e97-9f75-f538d319c390" path="/var/lib/kubelet/pods/9b5a2ce3-07b8-4e97-9f75-f538d319c390/volumes"
Jul 15 20:27:20.067943 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.067917    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:20.091247 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.091217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731556400_5f8e8920-58df-496b-a998-72f84583b38b/test-curl-7443-140511731556400/0.log"
Jul 15 20:27:20.113581 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.113557    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:20.119044 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.119016    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731556400"]
Jul 15 20:27:20.141453 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.141433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2kl8\" (UniqueName: \"kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8\") pod \"5f8e8920-58df-496b-a998-72f84583b38b\" (UID: \"5f8e8920-58df-496b-a998-72f84583b38b\") "
Jul 15 20:27:20.143512 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.143463    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8" (OuterVolumeSpecName: "kube-api-access-b2kl8") pod "5f8e8920-58df-496b-a998-72f84583b38b" (UID: "5f8e8920-58df-496b-a998-72f84583b38b"). InnerVolumeSpecName "kube-api-access-b2kl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:20.237033 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.236962    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:20.237296 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.237283    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8e8920-58df-496b-a998-72f84583b38b" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:20.237336 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.237297    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8e8920-58df-496b-a998-72f84583b38b" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:20.237366 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.237362    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8e8920-58df-496b-a998-72f84583b38b" containerName="test-curl-7443-140511731556400"
Jul 15 20:27:20.240046 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.240031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:20.242256 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.242235    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2kl8\" (UniqueName: \"kubernetes.io/projected/5f8e8920-58df-496b-a998-72f84583b38b-kube-api-access-b2kl8\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:20.247893 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.247874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:20.342786 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.342759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdx4q\" (UniqueName: \"kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q\") pod \"test-curl-7443-140511731557408\" (UID: \"83b167f1-ef3a-45b7-9c27-dd2ba4926271\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:20.443418 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.443396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdx4q\" (UniqueName: \"kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q\") pod \"test-curl-7443-140511731557408\" (UID: \"83b167f1-ef3a-45b7-9c27-dd2ba4926271\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:20.451886 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.451867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdx4q\" (UniqueName: \"kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q\") pod \"test-curl-7443-140511731557408\" (UID: \"83b167f1-ef3a-45b7-9c27-dd2ba4926271\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:20.550063 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.550040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:20.696588 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.696565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:20.698726 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:20.698686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83b167f1_ef3a_45b7_9c27_dd2ba4926271.slice/crio-c7fd5fb4e5d860680a10c11b93bb36b689f1759de397f94726f185d17b063799 WatchSource:0}: Error finding container c7fd5fb4e5d860680a10c11b93bb36b689f1759de397f94726f185d17b063799: Status 404 returned error can't find the container with id c7fd5fb4e5d860680a10c11b93bb36b689f1759de397f94726f185d17b063799
Jul 15 20:27:20.939942 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.939855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731557408" event={"ID":"83b167f1-ef3a-45b7-9c27-dd2ba4926271","Type":"ContainerStarted","Data":"c7fd5fb4e5d860680a10c11b93bb36b689f1759de397f94726f185d17b063799"}
Jul 15 20:27:20.941082 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.941064    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:20.941185 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:20.941082    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10698287d55043704c5193d937bc9bf34e56942552499a0f3832c6bad0f568d0"
Jul 15 20:27:20.951010 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:27:20.950984    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7443-140511731556400\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="5f8e8920-58df-496b-a998-72f84583b38b" pod="opendatahub/test-curl-7443-140511731556400"
Jul 15 20:27:21.118909 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:21.118878    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8e8920-58df-496b-a998-72f84583b38b" path="/var/lib/kubelet/pods/5f8e8920-58df-496b-a998-72f84583b38b/volumes"
Jul 15 20:27:21.877111 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:21.877068    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" podUID="cf6dccca-483e-49e5-ba53-f1a72664447a" containerName="main" containerID="cri-o://743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c" gracePeriod=45
Jul 15 20:27:21.952761 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:21.952724    2580 generic.go:356] "Generic (PLEG): container finished" podID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" containerID="6be253ead5253c3e9d5f3242516ba97ab07c96d2b0f4ea7ae065ad3bf9212796" exitCode=0
Jul 15 20:27:21.952937 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:21.952789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731557408" event={"ID":"83b167f1-ef3a-45b7-9c27-dd2ba4926271","Type":"ContainerDied","Data":"6be253ead5253c3e9d5f3242516ba97ab07c96d2b0f4ea7ae065ad3bf9212796"}
Jul 15 20:27:22.127592 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.127539    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:27:22.261127 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261099    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261275 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261275 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261191    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgstl\" (UniqueName: \"kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261275 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261222    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261275 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261246    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261275 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home\") pod \"cf6dccca-483e-49e5-ba53-f1a72664447a\" (UID: \"cf6dccca-483e-49e5-ba53-f1a72664447a\") "
Jul 15 20:27:22.261573 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261402    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:22.261573 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:22.261573 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261539    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-tmp-dir\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.261573 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261556    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-model-cache\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.261808 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.261660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home" (OuterVolumeSpecName: "home") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:22.263510 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.263464    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:27:22.263614 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.263548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm" (OuterVolumeSpecName: "dshm") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:22.263614 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.263565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl" (OuterVolumeSpecName: "kube-api-access-hgstl") pod "cf6dccca-483e-49e5-ba53-f1a72664447a" (UID: "cf6dccca-483e-49e5-ba53-f1a72664447a"). InnerVolumeSpecName "kube-api-access-hgstl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:22.362512 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.362468    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgstl\" (UniqueName: \"kubernetes.io/projected/cf6dccca-483e-49e5-ba53-f1a72664447a-kube-api-access-hgstl\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.362512 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.362512    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf6dccca-483e-49e5-ba53-f1a72664447a-tls-certs\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.362747 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.362522    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-dshm\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.362747 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.362529    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf6dccca-483e-49e5-ba53-f1a72664447a-home\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.958948 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.958914    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf6dccca-483e-49e5-ba53-f1a72664447a" containerID="743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c" exitCode=0
Jul 15 20:27:22.959147 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.958961    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"
Jul 15 20:27:22.959147 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.958999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" event={"ID":"cf6dccca-483e-49e5-ba53-f1a72664447a","Type":"ContainerDied","Data":"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"}
Jul 15 20:27:22.959147 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.959048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66" event={"ID":"cf6dccca-483e-49e5-ba53-f1a72664447a","Type":"ContainerDied","Data":"62d8839d1ef92f644f8b849ecc33c0d33721bf2edf7f3088b66c24e094ef9f24"}
Jul 15 20:27:22.959147 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.959064    2580 scope.go:117] "RemoveContainer" containerID="743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"
Jul 15 20:27:22.968840 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.968816    2580 scope.go:117] "RemoveContainer" containerID="743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"
Jul 15 20:27:22.969096 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:27:22.969079    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c\": container with ID starting with 743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c not found: ID does not exist" containerID="743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"
Jul 15 20:27:22.969191 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.969104    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c"} err="failed to get container status \"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c\": rpc error: code = NotFound desc = could not find container \"743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c\": container with ID starting with 743a528d397d4d7fed76c438767d8835cb02d0193148f4c66cfd89c2de857c4c not found: ID does not exist"
Jul 15 20:27:22.980734 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.980711    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:27:22.986286 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:22.986264    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/rate-test-model-54098e-kserve-5575d55687-slg66"]
Jul 15 20:27:23.092564 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.092537    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.113614 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.113589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731557408_83b167f1-ef3a-45b7-9c27-dd2ba4926271/test-curl-7443-140511731557408/0.log"
Jul 15 20:27:23.118768 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.118743    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6dccca-483e-49e5-ba53-f1a72664447a" path="/var/lib/kubelet/pods/cf6dccca-483e-49e5-ba53-f1a72664447a/volumes"
Jul 15 20:27:23.137497 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.137457    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:23.139730 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.139699    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:23.263190 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263160    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:23.263566 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263549    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:23.263660 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263568    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:23.263660 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263582    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6dccca-483e-49e5-ba53-f1a72664447a" containerName="main"
Jul 15 20:27:23.263660 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263590    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6dccca-483e-49e5-ba53-f1a72664447a" containerName="main"
Jul 15 20:27:23.263815 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263675    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:23.263815 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.263691    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6dccca-483e-49e5-ba53-f1a72664447a" containerName="main"
Jul 15 20:27:23.266686 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.266668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.269172 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.269155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdx4q\" (UniqueName: \"kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q\") pod \"83b167f1-ef3a-45b7-9c27-dd2ba4926271\" (UID: \"83b167f1-ef3a-45b7-9c27-dd2ba4926271\") "
Jul 15 20:27:23.272164 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.272132    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q" (OuterVolumeSpecName: "kube-api-access-hdx4q") pod "83b167f1-ef3a-45b7-9c27-dd2ba4926271" (UID: "83b167f1-ef3a-45b7-9c27-dd2ba4926271"). InnerVolumeSpecName "kube-api-access-hdx4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:23.273681 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.273660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:23.370593 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.370566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgxkp\" (UniqueName: \"kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp\") pod \"test-curl-7443-140511731557408\" (UID: \"4e9f63cb-6893-453f-a7b1-33b3f691320c\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.370759 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.370738    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdx4q\" (UniqueName: \"kubernetes.io/projected/83b167f1-ef3a-45b7-9c27-dd2ba4926271-kube-api-access-hdx4q\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:23.472100 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.472069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgxkp\" (UniqueName: \"kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp\") pod \"test-curl-7443-140511731557408\" (UID: \"4e9f63cb-6893-453f-a7b1-33b3f691320c\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.481189 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.481164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgxkp\" (UniqueName: \"kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp\") pod \"test-curl-7443-140511731557408\" (UID: \"4e9f63cb-6893-453f-a7b1-33b3f691320c\") " pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.585507 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.585418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.720214 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.720064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:23.722861 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:23.722814    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e9f63cb_6893_453f_a7b1_33b3f691320c.slice/crio-472cbad7324a685d7b5fb676dca478993c97d181a4287bbb066eadec324d8245 WatchSource:0}: Error finding container 472cbad7324a685d7b5fb676dca478993c97d181a4287bbb066eadec324d8245: Status 404 returned error can't find the container with id 472cbad7324a685d7b5fb676dca478993c97d181a4287bbb066eadec324d8245
Jul 15 20:27:23.965724 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.965640    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:23.965724 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.965643    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7fd5fb4e5d860680a10c11b93bb36b689f1759de397f94726f185d17b063799"
Jul 15 20:27:23.966656 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.966634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731557408" event={"ID":"4e9f63cb-6893-453f-a7b1-33b3f691320c","Type":"ContainerStarted","Data":"472cbad7324a685d7b5fb676dca478993c97d181a4287bbb066eadec324d8245"}
Jul 15 20:27:23.979633 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:23.979606    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7443-140511731557408" oldPodUID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c"
Jul 15 20:27:24.974050 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:24.974018    2580 generic.go:356] "Generic (PLEG): container finished" podID="4e9f63cb-6893-453f-a7b1-33b3f691320c" containerID="aaee9fafc750e6deeab8545d2719216b1ebd7855dd0c11d6fe2c03fc5996746a" exitCode=0
Jul 15 20:27:24.974422 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:24.974062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7443-140511731557408" event={"ID":"4e9f63cb-6893-453f-a7b1-33b3f691320c","Type":"ContainerDied","Data":"aaee9fafc750e6deeab8545d2719216b1ebd7855dd0c11d6fe2c03fc5996746a"}
Jul 15 20:27:25.117497 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:25.117455    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b167f1-ef3a-45b7-9c27-dd2ba4926271" path="/var/lib/kubelet/pods/83b167f1-ef3a-45b7-9c27-dd2ba4926271/volumes"
Jul 15 20:27:26.111953 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.111931    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:26.132551 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.132529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7443-140511731557408_4e9f63cb-6893-453f-a7b1-33b3f691320c/test-curl-7443-140511731557408/0.log"
Jul 15 20:27:26.152990 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.152968    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:26.156678 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.156658    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7443-140511731557408"]
Jul 15 20:27:26.296462 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.296436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgxkp\" (UniqueName: \"kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp\") pod \"4e9f63cb-6893-453f-a7b1-33b3f691320c\" (UID: \"4e9f63cb-6893-453f-a7b1-33b3f691320c\") "
Jul 15 20:27:26.298510 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.298458    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp" (OuterVolumeSpecName: "kube-api-access-jgxkp") pod "4e9f63cb-6893-453f-a7b1-33b3f691320c" (UID: "4e9f63cb-6893-453f-a7b1-33b3f691320c"). InnerVolumeSpecName "kube-api-access-jgxkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:26.339031 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.338998    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"]
Jul 15 20:27:26.339390 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.339376    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:26.339434 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.339393    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:26.339499 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.339466    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" containerName="test-curl-7443-140511731557408"
Jul 15 20:27:26.342391 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.342377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:26.344687 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.344668    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 20:27:26.344780 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.344668    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkj8f\""
Jul 15 20:27:26.349799 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.349781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"]
Jul 15 20:27:26.397693 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.397668    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgxkp\" (UniqueName: \"kubernetes.io/projected/4e9f63cb-6893-453f-a7b1-33b3f691320c-kube-api-access-jgxkp\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:26.498256 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.498224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk\" (UID: \"bc7c4da3-e8d3-49ca-84e4-22502e26c94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:26.598998 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.598925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk\" (UID: \"bc7c4da3-e8d3-49ca-84e4-22502e26c94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:26.599581 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.599563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk\" (UID: \"bc7c4da3-e8d3-49ca-84e4-22502e26c94d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:26.654114 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.654086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:26.784941 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.784875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"]
Jul 15 20:27:26.787433 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:26.787408    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7c4da3_e8d3_49ca_84e4_22502e26c94d.slice/crio-a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223 WatchSource:0}: Error finding container a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223: Status 404 returned error can't find the container with id a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223
Jul 15 20:27:26.986270 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.986251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:26.986368 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.986275    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="472cbad7324a685d7b5fb676dca478993c97d181a4287bbb066eadec324d8245"
Jul 15 20:27:26.987819 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:26.987790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk" event={"ID":"bc7c4da3-e8d3-49ca-84e4-22502e26c94d","Type":"ContainerStarted","Data":"a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223"}
Jul 15 20:27:27.007098 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:27.007063    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk" podStartSLOduration=1.007050295 podStartE2EDuration="1.007050295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:27:27.00623836 +0000 UTC m=+2930.409618994" watchObservedRunningTime="2026-07-15 20:27:27.007050295 +0000 UTC m=+2930.410430935"
Jul 15 20:27:27.008252 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:27:27.008231    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7443-140511731557408\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:27.116587 ip-10-0-141-1 kubenswrapper[2580]: E0715 20:27:27.116560    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7443-140511731557408\" is forbidden: User \"system:node:ip-10-0-141-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-1.ec2.internal' and this object" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" pod="opendatahub/test-curl-7443-140511731557408"
Jul 15 20:27:27.117822 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:27.117798    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e9f63cb-6893-453f-a7b1-33b3f691320c" path="/var/lib/kubelet/pods/4e9f63cb-6893-453f-a7b1-33b3f691320c/volumes"
Jul 15 20:27:27.994255 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:27.994216    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc7c4da3-e8d3-49ca-84e4-22502e26c94d" containerID="5d76d1b7ed15fcc8fc46066c4ceb96b0343f54f2782acd87cf91d3577284b1c9" exitCode=0
Jul 15 20:27:27.994430 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:27.994307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk" event={"ID":"bc7c4da3-e8d3-49ca-84e4-22502e26c94d","Type":"ContainerDied","Data":"5d76d1b7ed15fcc8fc46066c4ceb96b0343f54f2782acd87cf91d3577284b1c9"}
Jul 15 20:27:29.130048 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:29.130021    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:29.322147 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:29.322076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca\") pod \"bc7c4da3-e8d3-49ca-84e4-22502e26c94d\" (UID: \"bc7c4da3-e8d3-49ca-84e4-22502e26c94d\") "
Jul 15 20:27:29.322387 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:29.322366    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bc7c4da3-e8d3-49ca-84e4-22502e26c94d" (UID: "bc7c4da3-e8d3-49ca-84e4-22502e26c94d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:27:29.422912 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:29.422886    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc7c4da3-e8d3-49ca-84e4-22502e26c94d-maas-api-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:30.005744 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:30.005717    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk"
Jul 15 20:27:30.005921 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:30.005751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk" event={"ID":"bc7c4da3-e8d3-49ca-84e4-22502e26c94d","Type":"ContainerDied","Data":"a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223"}
Jul 15 20:27:30.005921 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:30.005796    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0d678b5d424f83bce51ef4e2c53068cbea88b87d31b0c63f6327e8aa7f19223"
Jul 15 20:27:52.488160 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.488130    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"]
Jul 15 20:27:52.488634 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.488449    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7c4da3-e8d3-49ca-84e4-22502e26c94d" containerName="revoke-keys"
Jul 15 20:27:52.488634 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.488459    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7c4da3-e8d3-49ca-84e4-22502e26c94d" containerName="revoke-keys"
Jul 15 20:27:52.488634 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.488542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7c4da3-e8d3-49ca-84e4-22502e26c94d" containerName="revoke-keys"
Jul 15 20:27:52.491433 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.491417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:52.494024 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.494003    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 20:27:52.494154 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.494063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tkj8f\""
Jul 15 20:27:52.499268 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.499248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"]
Jul 15 20:27:52.615536 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.615499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9\" (UID: \"3b2ba8a4-b455-4c66-a5a1-9272daddbc84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:52.716709 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.716666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9\" (UID: \"3b2ba8a4-b455-4c66-a5a1-9272daddbc84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:52.717273 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.717251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9\" (UID: \"3b2ba8a4-b455-4c66-a5a1-9272daddbc84\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:52.802523 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.802472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:52.939422 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:52.939399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"]
Jul 15 20:27:52.941418 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:27:52.941391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2ba8a4_b455_4c66_a5a1_9272daddbc84.slice/crio-19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef WatchSource:0}: Error finding container 19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef: Status 404 returned error can't find the container with id 19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef
Jul 15 20:27:53.116841 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:53.116761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9" event={"ID":"3b2ba8a4-b455-4c66-a5a1-9272daddbc84","Type":"ContainerStarted","Data":"19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef"}
Jul 15 20:27:54.122639 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:54.122549    2580 generic.go:356] "Generic (PLEG): container finished" podID="3b2ba8a4-b455-4c66-a5a1-9272daddbc84" containerID="2d15950ab2a907fb5ad453d0fcdd1674749ad466541846d911817295c477ed31" exitCode=0
Jul 15 20:27:54.122983 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:54.122632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9" event={"ID":"3b2ba8a4-b455-4c66-a5a1-9272daddbc84","Type":"ContainerDied","Data":"2d15950ab2a907fb5ad453d0fcdd1674749ad466541846d911817295c477ed31"}
Jul 15 20:27:55.255384 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:55.255360    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:55.338121 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:55.338091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca\") pod \"3b2ba8a4-b455-4c66-a5a1-9272daddbc84\" (UID: \"3b2ba8a4-b455-4c66-a5a1-9272daddbc84\") "
Jul 15 20:27:55.338418 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:55.338397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b2ba8a4-b455-4c66-a5a1-9272daddbc84" (UID: "3b2ba8a4-b455-4c66-a5a1-9272daddbc84"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:27:55.439316 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:55.439249    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2ba8a4-b455-4c66-a5a1-9272daddbc84-maas-api-service-ca\") on node \"ip-10-0-141-1.ec2.internal\" DevicePath \"\""
Jul 15 20:27:56.133176 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:56.133141    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9"
Jul 15 20:27:56.133364 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:56.133150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9" event={"ID":"3b2ba8a4-b455-4c66-a5a1-9272daddbc84","Type":"ContainerDied","Data":"19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef"}
Jul 15 20:27:56.133364 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:27:56.133271    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19d88df27c1e43463304b644666e9eba7700fe133ba5ddb02dffaac1334433ef"
Jul 15 20:28:24.317019 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:24.316947    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kx4fl_09c54d75-bde3-42f7-8b39-680bb03b08ec/manager/0.log"
Jul 15 20:28:24.935932 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:24.935903    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq_041a1982-66f3-4ad8-81ac-0e3af9378712/copy-manifests/0.log"
Jul 15 20:28:24.953504 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:24.953454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq_041a1982-66f3-4ad8-81ac-0e3af9378712/manager/0.log"
Jul 15 20:28:26.063672 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:26.063642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-cae23a-mnxhq_0ae789b1-af95-4480-a2f7-91d0bd1e5bdb/revoke-keys/0.log"
Jul 15 20:28:26.977454 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:26.977426    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-3ada3b-56rjk_bc7c4da3-e8d3-49ca-84e4-22502e26c94d/revoke-keys/0.log"
Jul 15 20:28:27.093996 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:27.093970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-54098e-xqsh9_3b2ba8a4-b455-4c66-a5a1-9272daddbc84/revoke-keys/0.log"
Jul 15 20:28:29.128281 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:29.128249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zwfxw_b0165014-a388-4d8d-8cb1-5cba54feb276/manager/0.log"
Jul 15 20:28:29.955100 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:29.955074    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-58s7t_a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7/kube-auth-proxy/0.log"
Jul 15 20:28:31.111126 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:31.111095    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cl2m8_793785d9-5eb6-4afb-852d-4c6ee13de688/main/0.log"
Jul 15 20:28:31.330872 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:31.330848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-px4j5_b43c3641-5644-467a-bc86-a26e5bad42df/main/0.log"
Jul 15 20:28:31.436513 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:31.436428    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-dtxhn_1a5acbe5-138f-4207-b8e5-e0f40ac1af92/main/0.log"
Jul 15 20:28:37.200522 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.200497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:28:37.207778 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.207760    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zl76c_384de95f-bb53-4f83-a514-c8490613b0b6/ovn-acl-logging/0.log"
Jul 15 20:28:37.274268 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.274235    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8sl5g/must-gather-wkrjm"]
Jul 15 20:28:37.274580 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.274568    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2ba8a4-b455-4c66-a5a1-9272daddbc84" containerName="revoke-keys"
Jul 15 20:28:37.274580 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.274582    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2ba8a4-b455-4c66-a5a1-9272daddbc84" containerName="revoke-keys"
Jul 15 20:28:37.274676 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.274640    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2ba8a4-b455-4c66-a5a1-9272daddbc84" containerName="revoke-keys"
Jul 15 20:28:37.277882 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.277863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.280205 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.280185    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sl5g\"/\"openshift-service-ca.crt\""
Jul 15 20:28:37.280312 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.280190    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sl5g\"/\"kube-root-ca.crt\""
Jul 15 20:28:37.280817 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.280798    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8sl5g\"/\"default-dockercfg-8lcv6\""
Jul 15 20:28:37.289832 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.289728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/must-gather-wkrjm"]
Jul 15 20:28:37.400936 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.400903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9x7\" (UniqueName: \"kubernetes.io/projected/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-kube-api-access-lx9x7\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.401111 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.400961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-must-gather-output\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.502348 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.502321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-must-gather-output\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.502533 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.502378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9x7\" (UniqueName: \"kubernetes.io/projected/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-kube-api-access-lx9x7\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.502726 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.502705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-must-gather-output\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.514193 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.514172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9x7\" (UniqueName: \"kubernetes.io/projected/2fff0b80-77d5-4915-b5a6-bd8bfa87dcce-kube-api-access-lx9x7\") pod \"must-gather-wkrjm\" (UID: \"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce\") " pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.590902 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.590876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/must-gather-wkrjm"
Jul 15 20:28:37.727633 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:37.727598    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/must-gather-wkrjm"]
Jul 15 20:28:37.730814 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:28:37.730790    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fff0b80_77d5_4915_b5a6_bd8bfa87dcce.slice/crio-2acc389a705abf60a8d0cc1b9d279835c6dcaed6242968de34fe4b1c8dfdb15b WatchSource:0}: Error finding container 2acc389a705abf60a8d0cc1b9d279835c6dcaed6242968de34fe4b1c8dfdb15b: Status 404 returned error can't find the container with id 2acc389a705abf60a8d0cc1b9d279835c6dcaed6242968de34fe4b1c8dfdb15b
Jul 15 20:28:38.327226 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:38.327195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/must-gather-wkrjm" event={"ID":"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce","Type":"ContainerStarted","Data":"2acc389a705abf60a8d0cc1b9d279835c6dcaed6242968de34fe4b1c8dfdb15b"}
Jul 15 20:28:39.336895 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:39.336862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/must-gather-wkrjm" event={"ID":"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce","Type":"ContainerStarted","Data":"7a474ba7eae250b4125ed3b1abf4112642896c061d2ac248222dc86e0d31dda6"}
Jul 15 20:28:39.336895 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:39.336903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/must-gather-wkrjm" event={"ID":"2fff0b80-77d5-4915-b5a6-bd8bfa87dcce","Type":"ContainerStarted","Data":"8ee221145f34e7ce35eeb4d477ea275af01ae727147711819f3d1b44c6b8614a"}
Jul 15 20:28:39.357568 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:39.357458    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8sl5g/must-gather-wkrjm" podStartSLOduration=1.274759007 podStartE2EDuration="2.357435277s" totalImagesPullingTime="1.08267627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:28:39.356767129 +0000 UTC m=+3002.760147766" watchObservedRunningTime="2026-07-15 20:28:39.357435277 +0000 UTC m=+3002.760815914"
Jul 15 20:28:40.597246 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:40.597222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wcssg_8575b3d1-81c5-4684-aa18-63ec8d028373/global-pull-secret-syncer/0.log"
Jul 15 20:28:40.695640 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:40.695607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mmttc_5c407be5-be0e-4b3c-8b5e-39ef303ee808/konnectivity-agent/0.log"
Jul 15 20:28:40.817421 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:40.817391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-1.ec2.internal_c7e403cd9bea9a483eb12fa077866f3f/haproxy/0.log"
Jul 15 20:28:46.399292 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:46.399183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zwfxw_b0165014-a388-4d8d-8cb1-5cba54feb276/manager/0.log"
Jul 15 20:28:48.435853 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.435775    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-fzknq_56aadaa1-a6de-4370-b25a-ba300c217b17/kube-state-metrics/0.log"
Jul 15 20:28:48.456111 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.456082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-fzknq_56aadaa1-a6de-4370-b25a-ba300c217b17/kube-rbac-proxy-main/0.log"
Jul 15 20:28:48.484183 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.484162    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-fzknq_56aadaa1-a6de-4370-b25a-ba300c217b17/kube-rbac-proxy-self/0.log"
Jul 15 20:28:48.518178 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.518150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d69f69757-tplh4_2ca12397-a2cf-429d-bdb5-c81772af9ddb/metrics-server/0.log"
Jul 15 20:28:48.549238 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.549207    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-lg7kt_096243ab-f2cc-42d5-bdb3-d2ded14aaa7e/monitoring-plugin/0.log"
Jul 15 20:28:48.653752 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.653720    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqmxg_f1360144-95b3-4267-8aae-23276c84206e/node-exporter/0.log"
Jul 15 20:28:48.678408 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.678358    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqmxg_f1360144-95b3-4267-8aae-23276c84206e/kube-rbac-proxy/0.log"
Jul 15 20:28:48.701838 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.701713    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqmxg_f1360144-95b3-4267-8aae-23276c84206e/init-textfile/0.log"
Jul 15 20:28:48.814835 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.814796    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l78zp_9b1dbfbe-c3f6-499f-ad2b-af7de41de139/kube-rbac-proxy-main/0.log"
Jul 15 20:28:48.837542 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.837509    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l78zp_9b1dbfbe-c3f6-499f-ad2b-af7de41de139/kube-rbac-proxy-self/0.log"
Jul 15 20:28:48.861983 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.861952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-l78zp_9b1dbfbe-c3f6-499f-ad2b-af7de41de139/openshift-state-metrics/0.log"
Jul 15 20:28:48.906416 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.906373    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/prometheus/0.log"
Jul 15 20:28:48.929144 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.929119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/config-reloader/0.log"
Jul 15 20:28:48.951239 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.951208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/thanos-sidecar/0.log"
Jul 15 20:28:48.973793 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.973725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/kube-rbac-proxy-web/0.log"
Jul 15 20:28:48.995403 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:48.995374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/kube-rbac-proxy/0.log"
Jul 15 20:28:49.017160 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:49.017114    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/kube-rbac-proxy-thanos/0.log"
Jul 15 20:28:49.046029 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:49.046001    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e349c92-7cc8-4868-997b-cccb32e72bf1/init-config-reloader/0.log"
Jul 15 20:28:49.075451 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:49.075404    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wt24n_190a6cd5-a30e-4a41-bec2-c5fc700d072f/prometheus-operator/0.log"
Jul 15 20:28:49.097311 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:49.097283    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wt24n_190a6cd5-a30e-4a41-bec2-c5fc700d072f/kube-rbac-proxy/0.log"
Jul 15 20:28:49.125732 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:49.125703    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-bgc7l_8c65dc07-4385-409c-b34b-ffdab18a0dd8/prometheus-operator-admission-webhook/0.log"
Jul 15 20:28:50.278097 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.278065    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"]
Jul 15 20:28:50.283164 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.283137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.293904 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.293868    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"]
Jul 15 20:28:50.448582 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.448555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-podres\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.448766 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.448591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-sys\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.448766 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.448609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzjs7\" (UniqueName: \"kubernetes.io/projected/161d90f9-9a81-4244-bf42-cc57f5df4872-kube-api-access-gzjs7\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.448766 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.448634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-lib-modules\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.448766 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.448732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-proc\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.549447 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.549354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-lib-modules\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.549860 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.549829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-lib-modules\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.549860 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.549858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-proc\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.549997 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.549980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-podres\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.550034 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.550019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-sys\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.550077 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.550045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzjs7\" (UniqueName: \"kubernetes.io/projected/161d90f9-9a81-4244-bf42-cc57f5df4872-kube-api-access-gzjs7\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.550518 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.550465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-proc\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.550619 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.550603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-podres\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.550675 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.550658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161d90f9-9a81-4244-bf42-cc57f5df4872-sys\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.559859 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.559830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzjs7\" (UniqueName: \"kubernetes.io/projected/161d90f9-9a81-4244-bf42-cc57f5df4872-kube-api-access-gzjs7\") pod \"perf-node-gather-daemonset-9nsrv\" (UID: \"161d90f9-9a81-4244-bf42-cc57f5df4872\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.608568 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.608532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:50.788984 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:50.788954    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"]
Jul 15 20:28:50.798497 ip-10-0-141-1 kubenswrapper[2580]: W0715 20:28:50.796610    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod161d90f9_9a81_4244_bf42_cc57f5df4872.slice/crio-8932af9d5086ab330ba0840dbfc1e3954d47be09630a3440081dfca570f2c7bc WatchSource:0}: Error finding container 8932af9d5086ab330ba0840dbfc1e3954d47be09630a3440081dfca570f2c7bc: Status 404 returned error can't find the container with id 8932af9d5086ab330ba0840dbfc1e3954d47be09630a3440081dfca570f2c7bc
Jul 15 20:28:51.444201 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:51.444164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv" event={"ID":"161d90f9-9a81-4244-bf42-cc57f5df4872","Type":"ContainerStarted","Data":"776a231e47247559009fe1b5adc72634c6eefef6b0a2fcc60f13e8fbcb640898"}
Jul 15 20:28:51.444683 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:51.444370    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:51.444683 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:51.444436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv" event={"ID":"161d90f9-9a81-4244-bf42-cc57f5df4872","Type":"ContainerStarted","Data":"8932af9d5086ab330ba0840dbfc1e3954d47be09630a3440081dfca570f2c7bc"}
Jul 15 20:28:51.463445 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:51.463386    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv" podStartSLOduration=1.463364571 podStartE2EDuration="1.463364571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:28:51.461803484 +0000 UTC m=+3014.865184126" watchObservedRunningTime="2026-07-15 20:28:51.463364571 +0000 UTC m=+3014.866745211"
Jul 15 20:28:53.315679 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:53.315646    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st5nh_b082089c-3842-4491-9dbf-0711c896d3b3/dns/0.log"
Jul 15 20:28:53.338297 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:53.338273    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-st5nh_b082089c-3842-4491-9dbf-0711c896d3b3/kube-rbac-proxy/0.log"
Jul 15 20:28:53.438953 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:53.438923    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r9zm6_3c415cac-77c5-4acb-9b85-ddd9c39f7fcf/dns-node-resolver/0.log"
Jul 15 20:28:54.055260 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:54.055233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xg7d_7f49c0da-2b9d-43bb-ab8a-5828bb4da058/node-ca/0.log"
Jul 15 20:28:55.243716 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:55.243687    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-58s7t_a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7/kube-auth-proxy/0.log"
Jul 15 20:28:56.180662 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:56.180627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rpmtv_43f3af47-1ef6-4bf4-8aed-d5ef340aaae4/serve-healthcheck-canary/0.log"
Jul 15 20:28:56.761597 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:56.761549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dqplb_df44623e-f1ba-4cd4-ab66-64a15dbc75c7/kube-rbac-proxy/0.log"
Jul 15 20:28:56.816178 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:56.816144    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dqplb_df44623e-f1ba-4cd4-ab66-64a15dbc75c7/exporter/0.log"
Jul 15 20:28:56.860910 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:56.860881    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dqplb_df44623e-f1ba-4cd4-ab66-64a15dbc75c7/extractor/0.log"
Jul 15 20:28:57.465884 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:57.465859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-9nsrv"
Jul 15 20:28:59.434162 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:59.434080    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kx4fl_09c54d75-bde3-42f7-8b39-680bb03b08ec/manager/0.log"
Jul 15 20:28:59.856774 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:59.856742    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq_041a1982-66f3-4ad8-81ac-0e3af9378712/manager/0.log"
Jul 15 20:28:59.886273 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:28:59.886230    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-mkjzq_041a1982-66f3-4ad8-81ac-0e3af9378712/copy-manifests/0.log"
Jul 15 20:29:01.066438 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:29:01.066407    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-58s7t_a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7/kube-auth-proxy/0.log"
Jul 15 20:29:01.370082 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:29:01.369993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c89ffd76c-n9f5m_2744ccd2-bf67-4729-a59b-4be801dc626b/manager/0.log"
Jul 15 20:29:02.572001 ip-10-0-141-1 kubenswrapper[2580]: I0715 20:29:02.571897    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-58s7t_a5ca1e1e-a0e9-4a84-9305-49dad5cb12a7/kube-auth-proxy/0.log"