Jul 07 02:12:36.567924 ip-10-0-142-72 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 02:12:36.567936 ip-10-0-142-72 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 02:12:36.567944 ip-10-0-142-72 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 02:12:36.568194 ip-10-0-142-72 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 02:12:46.735675 ip-10-0-142-72 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 02:12:46.735697 ip-10-0-142-72 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f085cb9d790945bba3b97fb26ac9e6b0 --
Jul 07 02:14:44.881113 ip-10-0-142-72 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 02:14:45.286751 ip-10-0-142-72 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:45.286751 ip-10-0-142-72 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 02:14:45.286751 ip-10-0-142-72 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:45.286751 ip-10-0-142-72 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 02:14:45.286751 ip-10-0-142-72 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 02:14:45.287456 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.286816    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 02:14:45.290562 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290541    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.290562 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290560    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.290562 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290564    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290568    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290572    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290575    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290579    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290581    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290584    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290586    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290589    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290592    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290600    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290603    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290606    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290609    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290611    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290614    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290618    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290622    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290625    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.290657 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290627    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290630    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290632    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290634    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290637    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290639    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290642    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290644    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290646    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290649    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290651    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290654    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290656    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290659    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290662    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290664    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290667    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290670    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290672    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290675    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.291138 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290678    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290680    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290683    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290685    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290690    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290693    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290695    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290698    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290700    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290702    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290705    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290707    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290709    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290712    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290717    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290721    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290723    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290726    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290729    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.291623 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290732    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290734    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290737    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290740    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290742    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290745    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290748    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290750    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290753    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290756    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290758    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290761    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290763    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290766    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290768    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290770    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290773    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290789    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290793    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290795    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.292121 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290798    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290800    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290803    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290805    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290808    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290811    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290814    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290817    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290821    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290824    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290828    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290832    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290835    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290838    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290840    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290843    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290845    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290848    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.290850    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.292606 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291578    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291584    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291587    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291590    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291592    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291595    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291597    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291600    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291602    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291605    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291608    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291610    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291613    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291616    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291618    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291621    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291623    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291626    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291629    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.293104 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291634    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291639    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291642    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291645    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291648    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291651    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291653    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291656    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291658    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291661    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291664    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291666    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291669    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291672    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291674    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291676    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291679    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291681    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291684    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291687    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291689    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.293670 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291692    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291695    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291698    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291701    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291703    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291706    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291708    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291711    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291713    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291716    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291718    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291721    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291723    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291726    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291729    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291732    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291734    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291736    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291739    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291741    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.294195 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291743    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291747    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291750    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291753    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291755    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291758    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291761    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291763    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291766    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291768    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291770    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291773    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291775    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291794    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291797    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291799    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291803    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291807    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291810    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.294702 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291814    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291816    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291820    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291823    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291826    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291829    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291831    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291834    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291836    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291839    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291841    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291844    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291846    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291848    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291851    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291853    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291855    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291858    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291860    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.291863    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.295205 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292292    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292297    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292299    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292302    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292305    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292308    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292310    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292313    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292316    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292318    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292321    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292324    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292327    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292330    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292332    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292337    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292341    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292344    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292347    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.295692 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292349    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292352    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292354    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292356    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292359    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292362    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292364    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292367    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292369    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292371    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292374    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292376    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292379    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292381    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292383    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292386    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292388    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292391    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292393    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292395    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.296228 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292398    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292401    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292403    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292406    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292408    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292418    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292421    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292423    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292426    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292429    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292431    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292435    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292438    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292441    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292444    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292447    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292450    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292453    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292456    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.296709 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292458    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292460    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292463    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292466    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292468    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292471    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292473    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292475    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292479    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292482    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292484    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292486    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292489    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292491    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292494    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292496    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292499    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292501    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292504    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292506    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.297216 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292509    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292511    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292514    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292517    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292521    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292523    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292526    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292529    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292531    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292534    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292537    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292539    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292542    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292544    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292547    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292549    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292552    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292554    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292556    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.297748 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292559    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.292561    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292638    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292649    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292656    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292661    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292666    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292669    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292673    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292677    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292681    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292683    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292687    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292690    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292694    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292697    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292699    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292702    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292704    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292707    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292711    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292714    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292717    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292721    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 02:14:45.298231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292724    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292728    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292731    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292733    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292736    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292739    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292742    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292745    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292749    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292752    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292756    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292759    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292761    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292764    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292767    2559 flags.go:64] FLAG: --enable-server="true"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292770    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292791    2559 flags.go:64] FLAG: --event-burst="100"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292794    2559 flags.go:64] FLAG: --event-qps="50"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292798    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292801    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292803    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292807    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292811    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292814    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292816    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 07 02:14:45.298837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292819    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292822    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292825    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292827    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292830    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292835    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292838    2559 flags.go:64] FLAG: --feature-gates=""
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292842    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292845    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292848    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292851    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292854    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292857    2559 flags.go:64] FLAG: --help="false"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292860    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292863    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292866    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292869    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292872    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292875    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292878    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292881    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292884    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292887    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 02:14:45.299435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292890    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292893    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292896    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292899    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292901    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292904    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292907    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292910    2559 flags.go:64] FLAG: --lock-file=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292913    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292916    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292919    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292925    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292927    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292930    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292935    2559 flags.go:64] FLAG: --logging-format="text"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292937    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292940    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292943    2559 flags.go:64] FLAG: --manifest-url=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292946    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292951    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292953    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292957    2559 flags.go:64] FLAG: --max-pods="110"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292961    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292963    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292967    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 02:14:45.300064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292970    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292973    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292976    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292979    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292986    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292989    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292992    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292995    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.292997    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293003    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293006    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293009    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293012    2559 flags.go:64] FLAG: --port="10250"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293015    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293017    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0067cd7aa76e84c56"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293021    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293024    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293026    2559 flags.go:64] FLAG: --register-node="true"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293029    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293033    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293036    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293040    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293042    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293046    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293049    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 02:14:45.300675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293052    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293055    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293057    2559 flags.go:64] FLAG: --runonce="false"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293060    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293063    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293066    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293069    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293072    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293075    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293078    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293081    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293084    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293090    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293093    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293096    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293099    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293101    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293104    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293109    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293112    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293115    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293119    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293122    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293125    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293128    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 02:14:45.301344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293131    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293134    2559 flags.go:64] FLAG: --v="2"
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293138    2559 flags.go:64] FLAG: --version="false"
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293142    2559 flags.go:64] FLAG: --vmodule=""
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293146    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.293149    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293270    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293273    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293276    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293278    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293281    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293284    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293287    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293289    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293292    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293294    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293297    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293299    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293301    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293305    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293308    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.301965 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293310    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293313    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293315    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293318    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293320    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293323    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293325    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293328    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293330    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293333    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293336    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293338    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293341    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293343    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293348    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293350    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293352    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293355    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293357    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293360    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.302821 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293362    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293364    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293367    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293370    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293372    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293374    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293377    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293380    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293382    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293384    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293388    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293392    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293395    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293398    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293400    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293403    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293405    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293407    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293410    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293412    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.303505 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293414    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293417    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293419    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293422    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293425    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293427    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293431    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293433    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293436    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293438    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293441    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293444    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293448    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293451    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293454    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293456    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293459    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293462    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293465    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.304037 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293467    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293470    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293472    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293476    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293478    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293481    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293483    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293486    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293488    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293491    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293493    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293495    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293498    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293500    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293504    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293507    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293510    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293513    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293515    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293520    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.304519 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293522    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293525    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293527    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293530    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.293532    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.294208    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.301801    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.301816    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.301837    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.301842    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302412    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302447    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302453    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302458    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302463    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.305033 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302467    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302472    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302479    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302493    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302498    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302503    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302507    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302512    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302516    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302520    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302524    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302529    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302533    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302537    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302542    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302546    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302557    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302563    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302568    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.305409 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302572    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302577    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302581    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302585    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302589    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302594    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302598    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302602    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302607    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302648    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302653    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302657    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302662    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302666    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302674    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302681    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302685    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302691    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302695    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302699    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.305964 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302706    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302710    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302720    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302724    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302731    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302736    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302740    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302744    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302748    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302753    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302757    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302761    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302765    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302770    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302774    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302801    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302806    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302810    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302814    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302817    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.306469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302822    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302827    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302863    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302868    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302872    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302877    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302881    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302890    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302894    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302898    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302902    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302906    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302910    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302914    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302918    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302922    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302926    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302930    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302935    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302943    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.306974 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302948    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302952    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302956    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302960    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302964    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302971    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302978    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302983    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302988    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302992    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.302996    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303000    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303010    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303014    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303018    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.307462 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.303059    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303722    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303733    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303736    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303739    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303742    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303745    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303748    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303751    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303753    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303756    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303760    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303765    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303768    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303771    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303774    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303795    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303798    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303801    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303804    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 02:14:45.307847 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303806    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303809    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303812    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303815    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303818    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303820    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303823    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303826    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303829    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303831    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303834    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303837    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303839    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303842    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303844    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303847    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303849    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303852    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303854    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303857    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 02:14:45.308380 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303859    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303862    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303864    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303868    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303872    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303875    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303877    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303881    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303884    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303887    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303890    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303893    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303895    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303898    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303900    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303903    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303907    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303909    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303912    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 02:14:45.308889 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303914    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303917    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303920    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303922    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303925    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303927    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303929    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303932    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303934    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303947    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303950    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303953    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303956    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303958    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303961    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303963    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303966    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303968    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303971    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 02:14:45.309352 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303973    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303975    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303978    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303981    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303983    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303987    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303989    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303992    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303995    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.303998    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304000    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304003    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304005    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304007    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304010    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304012    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304015    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304018    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304020    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304023    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 02:14:45.309827 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304025    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:45.304027    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.304034    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.304168    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.306498    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.307797    2559 server.go:1019] "Starting client certificate rotation"
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.307895    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:14:45.310300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.307931    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 02:14:45.310499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.310360    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:14:45.311935 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.311915    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 02:14:45.322288 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.322263    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 07 02:14:45.327064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.327044    2559 log.go:25] "Validated CRI v1 image API"
Jul 07 02:14:45.328887 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.328865    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 02:14:45.331496 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.331468    2559 fs.go:135] Filesystem UUIDs: map[10181468-fb5f-4068-bdec-013a7844350f:/dev/nvme0n1p4 3ada69e9-bc4b-43fd-9b59-0fd0ac360fd9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 02:14:45.331575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.331495    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 02:14:45.338575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.338446    2559 manager.go:216] Machine: {Timestamp:2026-07-07 02:14:45.336826748 +0000 UTC m=+0.332651276 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093411 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23fb70ddee522d2ecac0586270664e SystemUUID:ec23fb70-ddee-522d-2eca-c0586270664e BootID:f085cb9d-7909-45bb-a3b9-7fb26ac9e6b0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:ea:4e:36:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:ea:4e:36:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:e1:42:11:c1:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 02:14:45.338575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.338570    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 02:14:45.338720 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.338662    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 02:14:45.342043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.342012    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 02:14:45.342217 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.342044    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 02:14:45.342747 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.342736    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 02:14:45.342791 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.342749    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 02:14:45.342791 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.342757    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:14:45.343529 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.343512    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 02:14:45.345546 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.345535    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 02:14:45.348852 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.348836    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:14:45.348994 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.348984    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 02:14:45.349079 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349063    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 02:14:45.349079 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349077    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 02:14:45.349247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349088    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 02:14:45.349247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349123    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 07 02:14:45.349247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349138    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 02:14:45.349810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349767    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:14:45.349897 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.349814    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 02:14:45.352714 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.352691    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:14:45.354370 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.354347    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 02:14:45.356449 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.356431    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 02:14:45.356547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.356471    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 02:14:45.357653 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357638    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357659    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357669    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357676    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357689    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357696    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357708    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357716    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357727    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 02:14:45.357737 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357734    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 02:14:45.358019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357747    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 02:14:45.358019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.357755    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 02:14:45.358506 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.358495    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 02:14:45.358557 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.358509    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 02:14:45.361758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.361730    2559 server.go:1268] "Started kubelet"
Jul 07 02:14:45.361888 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.361831    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 02:14:45.361959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.361909    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 02:14:45.362005 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.361968    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 02:14:45.362695 ip-10-0-142-72 systemd[1]: Started Kubernetes Kubelet.
Jul 07 02:14:45.363896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.363873    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 02:14:45.364953 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.364937    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 02:14:45.366713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.366685    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 02:14:45.366816 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.366767    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 02:14:45.367299 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.367274    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 02:14:45.367299 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.367273    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 02:14:45.370396 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.369018    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03297cbb4ac  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.36170206 +0000 UTC m=+0.357526588,LastTimestamp:2026-07-07 02:14:45.36170206 +0000 UTC m=+0.357526588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.371248 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.371223    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 02:14:45.371248 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.371240    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 02:14:45.371385 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.371345    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.371949 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.371919    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 02:14:45.372030 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.371961    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 02:14:45.372030 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.371973    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 02:14:45.372254 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372149    2559 factory.go:55] Registering systemd factory
Jul 07 02:14:45.372254 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372154    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 02:14:45.372254 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372166    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 02:14:45.372254 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372185    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 07 02:14:45.372515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372439    2559 factory.go:153] Registering CRI-O factory
Jul 07 02:14:45.372515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372491    2559 factory.go:223] Registration of the crio container factory successfully
Jul 07 02:14:45.372598 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372573    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 02:14:45.372643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372611    2559 factory.go:103] Registering Raw factory
Jul 07 02:14:45.372697 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.372682    2559 manager.go:1196] Started watching for new ooms in manager
Jul 07 02:14:45.373446 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.373430    2559 manager.go:349] Starting recovery of all containers
Jul 07 02:14:45.381566 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.381309    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 02:14:45.381566 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.381350    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 02:14:45.386808 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.386771    2559 manager.go:354] Recovery completed
Jul 07 02:14:45.390988 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.390973    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.392762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.392740    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.392839 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.392793    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.392839 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.392808    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.393362 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.393346    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 02:14:45.393362 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.393359    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 02:14:45.393515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.393374    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 02:14:45.393515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.393391    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.394107 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394089    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.394183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394123    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.394183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394138    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.394597 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394584    2559 policy_none.go:49] "None policy: Start"
Jul 07 02:14:45.394643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394601    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 02:14:45.394643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.394611    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 02:14:45.395567 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.395557    2559 policy_none.go:47] "Start"
Jul 07 02:14:45.396037 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.395948    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a5a872  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392762994 +0000 UTC m=+0.388587522,LastTimestamp:2026-07-07 02:14:45.392762994 +0000 UTC m=+0.388587522,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.406639 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.406562    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a63d71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392801137 +0000 UTC m=+0.388625664,LastTimestamp:2026-07-07 02:14:45.392801137 +0000 UTC m=+0.388625664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.410649 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.410572    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a66929  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392812329 +0000 UTC m=+0.388636856,LastTimestamp:2026-07-07 02:14:45.392812329 +0000 UTC m=+0.388636856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.420829 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.420736    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-72.ec2.internal.18bfe03299a5a872\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a5a872  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392762994 +0000 UTC m=+0.388587522,LastTimestamp:2026-07-07 02:14:45.394106282 +0000 UTC m=+0.389930832,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.424744 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.424669    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-72.ec2.internal.18bfe03299a63d71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a63d71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392801137 +0000 UTC m=+0.388625664,LastTimestamp:2026-07-07 02:14:45.394130379 +0000 UTC m=+0.389954908,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.430981 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.430902    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-72.ec2.internal.18bfe03299a66929\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe03299a66929  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-72.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.392812329 +0000 UTC m=+0.388636856,LastTimestamp:2026-07-07 02:14:45.394144342 +0000 UTC m=+0.389968874,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.433410 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433395    2559 manager.go:337] "Starting Device Plugin manager"
Jul 07 02:14:45.433516 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.433430    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 02:14:45.433516 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433440    2559 server.go:87] "Starting device plugin registration server"
Jul 07 02:14:45.433748 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433736    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 02:14:45.433804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433752    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 02:14:45.433868 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433853    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 02:14:45.433972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433955    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 02:14:45.433972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.433968    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 02:14:45.434486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.434469    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 02:14:45.434554 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.434513    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.457299 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.457220    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-72.ec2.internal.18bfe0329d311f74  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-72.ec2.internal,UID:ip-10-0-142-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-72.ec2.internal,},FirstTimestamp:2026-07-07 02:14:45.452234612 +0000 UTC m=+0.448059131,LastTimestamp:2026-07-07 02:14:45.452234612 +0000 UTC m=+0.448059131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-72.ec2.internal,}"
Jul 07 02:14:45.467640 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.467612    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tm9bv"
Jul 07 02:14:45.482079 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.482057    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tm9bv"
Jul 07 02:14:45.534048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.534007    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.535206 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.534988    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.535206 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.535023    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.535206 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.535035    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.535206 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.535062    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.548739 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.548663    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 02:14:45.550081 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.550063    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 02:14:45.550158 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.550111    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 02:14:45.550158 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.550136    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 02:14:45.550248 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.550177    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 02:14:45.550626 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.550601    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.550858 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.550633    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-72.ec2.internal\": node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.552215 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.552195    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:45.598374 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.598343    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.650691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.650641    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"]
Jul 07 02:14:45.650867 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.650742    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.651688 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.651669    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.651802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.651698    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.651802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.651709    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.653237 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653223    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.653362 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.653421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653383    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.653964 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653950    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.654037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653975    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.654037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.653983    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.654037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.654020    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.654150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.654041    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.654150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.654050    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.655214 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.655200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.655278 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.655232    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 02:14:45.655926 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.655910    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 02:14:45.656037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.655944    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 02:14:45.656037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.655955    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeHasSufficientPID"
Jul 07 02:14:45.674566 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.674535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.674683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.674582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.674683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.674601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0ce01185dfdcbc31d8e5ab0d9274554-config\") pod \"kube-apiserver-proxy-ip-10-0-142-72.ec2.internal\" (UID: \"b0ce01185dfdcbc31d8e5ab0d9274554\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.685529 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.685509    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-72.ec2.internal\" not found" node="ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.689989 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.689966    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-72.ec2.internal\" not found" node="ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.699037 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.699014    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.775661 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.775661 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.775918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0ce01185dfdcbc31d8e5ab0d9274554-config\") pod \"kube-apiserver-proxy-ip-10-0-142-72.ec2.internal\" (UID: \"b0ce01185dfdcbc31d8e5ab0d9274554\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.775918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775716    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.775918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775724    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/73221a191ca5c147b7930be3913f71c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal\" (UID: \"73221a191ca5c147b7930be3913f71c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.775918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.775770    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0ce01185dfdcbc31d8e5ab0d9274554-config\") pod \"kube-apiserver-proxy-ip-10-0-142-72.ec2.internal\" (UID: \"b0ce01185dfdcbc31d8e5ab0d9274554\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.799848 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.799763    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.900538 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:45.900497    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:45.989121 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.989082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:45.994424 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:45.994406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:46.001387 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:46.001364    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:46.102293 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:46.102189    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:47.800585 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:47.800542    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-72.ec2.internal\" not found"
Jul 07 02:14:47.853741 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.853711    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:47.870037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.870006    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:47.882087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.882057    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:14:47.883584 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.883567    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal"
Jul 07 02:14:47.897004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.896980    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 02:14:47.900065 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.900046    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:47.905187 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.905169    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 02:14:47.905356 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.905337    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 02:14:47.905404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.905338    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 02:14:47.948250 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.948222    2559 apiserver.go:52] "Watching apiserver"
Jul 07 02:14:47.957125 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.957047    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 02:14:47.957408 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.957389    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-68szx","openshift-multus/multus-additional-cni-plugins-sk56z","openshift-multus/network-metrics-daemon-d5z2q","openshift-network-diagnostics/network-check-target-q5s84","openshift-ovn-kubernetes/ovnkube-node-nn6nm","kube-system/global-pull-secret-syncer-9sb67","kube-system/konnectivity-agent-fd69w","kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal","openshift-dns/node-resolver-x47k6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal","openshift-multus/multus-gwdld","openshift-network-operator/iptables-alerter-fgg7p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p","openshift-cluster-node-tuning-operator/tuned-dhtcv"]
Jul 07 02:14:47.959064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.959047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:47.960185 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.960168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.961592 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.961577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:47.961680 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:47.961646    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:47.962002 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.961987    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.962227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.962213    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.962311 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.962294    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 02:14:47.962558 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.962543    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c466h\""
Jul 07 02:14:47.962819 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.962803    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:47.962895 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:47.962869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:47.962987 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.962972    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 02:14:47.963133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.963115    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smf7v\""
Jul 07 02:14:47.963179 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.963129    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 02:14:47.963179 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.963149    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.963322 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.963310    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.963423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.963377    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 02:14:47.964129 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.964111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.965331 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.965313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:47.965421 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:47.965382    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:47.966554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.966534    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:47.967236 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967216    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 02:14:47.967236 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967238    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 02:14:47.967392 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 02:14:47.967392 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967261    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.967392 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967273    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fzwqs\""
Jul 07 02:14:47.967646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967631    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:47.967919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967896    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 02:14:47.967999 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.967951    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.968969 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.968951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.969157 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.969139    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 02:14:47.970009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.969993    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 02:14:47.970009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.970003    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 02:14:47.970160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.970003    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l6hwm\""
Jul 07 02:14:47.970256 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.970242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:47.970875 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.970860    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.970942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.970902    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.971438 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.971421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:47.971924 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.971908    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tbvrc\""
Jul 07 02:14:47.972686 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.972669    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 02:14:47.973326 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.972817    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fjzxh\""
Jul 07 02:14:47.973326 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.972922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:47.973326 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.972981    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 02:14:47.973326 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.972988    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.973326 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.973198    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.973795 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.973778    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rs549\""
Jul 07 02:14:47.974113 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.974099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 02:14:47.974191 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.974106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xgdcl\""
Jul 07 02:14:47.974818 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.974802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.974868 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.974824    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.976315 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.976293    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 02:14:47.976597 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.976580    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:14:47.977334 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3bdc6a-893c-458a-b3b5-88d95070e432-serviceca\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:47.977433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqdd\" (UniqueName: \"kubernetes.io/projected/eb3bdc6a-893c-458a-b3b5-88d95070e432-kube-api-access-5nqdd\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:47.977433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-conf-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.977433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hx45g\""
Jul 07 02:14:47.977433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-daemon-config\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.977629 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpt6\" (UniqueName: \"kubernetes.io/projected/1254f3fd-6b88-4183-8fd3-6012e6d6c751-kube-api-access-2hpt6\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:47.977629 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-etc-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.977629 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.977770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-env-overrides\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.977770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-host-slash\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:47.977770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-slash\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.977770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977758    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-log-socket\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.977979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:47.977979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-cnibin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.977979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-cni-binary-copy\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.977979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hmg\" (UniqueName: \"kubernetes.io/projected/47d8db85-7e8e-4950-b3bd-6660e869cd06-kube-api-access-98hmg\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.977986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-system-cni-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-system-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-k8s-cni-cncf-io\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-hostroot\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbjz\" (UniqueName: \"kubernetes.io/projected/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-kube-api-access-vvbjz\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:47.978559 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978594 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-systemd-units\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.978594 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-script-lib\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.978689 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-socket-dir-parent\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978689 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:47.978758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-kubelet\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.978758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-var-lib-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.978758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-config\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.978758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898a7b93-f6d5-41ac-9d47-5e1261bca15b-tmp-dir\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:47.978758 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-os-release\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-multus-certs\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-etc-kubernetes\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-cnibin\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-dbus\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3bdc6a-893c-458a-b3b5-88d95070e432-host\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-kubelet\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-os-release\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.978990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.978978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7v4k\" (UniqueName: \"kubernetes.io/projected/e070bbb3-86d8-4ce0-85e9-a06580b82315-kube-api-access-k7v4k\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-bin\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwnb\" (UniqueName: \"kubernetes.io/projected/600f989a-9562-4e79-82d5-09b6cf866d66-kube-api-access-xmwnb\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3731445d-3047-4c7e-bd3e-5e107723fcb0-agent-certs\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-ovn\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979151    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-iptables-alerter-script\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979178    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-netd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/600f989a-9562-4e79-82d5-09b6cf866d66-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/898a7b93-f6d5-41ac-9d47-5e1261bca15b-hosts-file\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:47.979242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpm68\" (UniqueName: \"kubernetes.io/projected/898a7b93-f6d5-41ac-9d47-5e1261bca15b-kube-api-access-hpm68\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-netns\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-bin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-systemd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-kubelet-config\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3731445d-3047-4c7e-bd3e-5e107723fcb0-konnectivity-ca\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-multus\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-netns\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.979731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.979485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-node-log\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:47.991823 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:47.991804    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 02:14:48.059810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.059788    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4mtx"
Jul 07 02:14:48.068718 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.068692    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4mtx"
Jul 07 02:14:48.070916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.070896    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 02:14:48.079896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-netns\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.079985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-bin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.079985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-systemd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.079985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.079985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079966    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-netns\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-kubelet-config\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.079997    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-bin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080015    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-kubelet-config\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3731445d-3047-4c7e-bd3e-5e107723fcb0-konnectivity-ca\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-multus\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080043    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-systemd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080058    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-sys\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080093    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-cni-multus\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-netns\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-node-log\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080159    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-netns\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-registration-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3bdc6a-893c-458a-b3b5-88d95070e432-serviceca\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080211    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-node-log\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqdd\" (UniqueName: \"kubernetes.io/projected/eb3bdc6a-893c-458a-b3b5-88d95070e432-kube-api-access-5nqdd\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-conf-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-daemon-config\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpt6\" (UniqueName: \"kubernetes.io/projected/1254f3fd-6b88-4183-8fd3-6012e6d6c751-kube-api-access-2hpt6\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-etc-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080447    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-conf-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-env-overrides\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3731445d-3047-4c7e-bd3e-5e107723fcb0-konnectivity-ca\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysconfig\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080501    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-etc-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080512    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.080977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-var-lib-kubelet\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-host-slash\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-slash\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-log-socket\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080657    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-host-slash\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080718    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-log-socket\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080729    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3bdc6a-893c-458a-b3b5-88d95070e432-serviceca\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.080764    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-slash\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-cnibin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.080825    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:48.580807351 +0000 UTC m=+1.978805680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-cni-binary-copy\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080861    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-cnibin\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hmg\" (UniqueName: \"kubernetes.io/projected/47d8db85-7e8e-4950-b3bd-6660e869cd06-kube-api-access-98hmg\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-system-cni-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.081752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-system-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080967    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-daemon-config\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.080997    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-system-cni-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-k8s-cni-cncf-io\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081015    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-env-overrides\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-hostroot\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-socket-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081077    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-k8s-cni-cncf-io\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081089    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbjz\" (UniqueName: \"kubernetes.io/projected/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-kube-api-access-vvbjz\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081142    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-system-cni-dir\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081150    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-hostroot\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-systemd-units\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081158    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.082478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081198    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-systemd-units\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-modprobe-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-tuned\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-script-lib\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-socket-dir-parent\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/47d8db85-7e8e-4950-b3bd-6660e869cd06-cni-binary-copy\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-host\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-sys-fs\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081356    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-multus-socket-dir-parent\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-run\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-kubelet\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-var-lib-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081459    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-config\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081468    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-kubelet\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898a7b93-f6d5-41ac-9d47-5e1261bca15b-tmp-dir\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-os-release\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081527    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081516    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 02:09:47 +0000 UTC" deadline="2027-12-21 03:24:55.139723931 +0000 UTC"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081557    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12769h10m7.058170198s"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081544    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-var-lib-openvswitch\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081586    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-multus-certs\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081591    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-run-multus-certs\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081647    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-os-release\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-etc-kubernetes\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-cnibin\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-dbus\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081721    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-etc-kubernetes\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-cnibin\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081761    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cdbf32e-b191-461f-9320-eeed64359999-dbus\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3bdc6a-893c-458a-b3b5-88d95070e432-host\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-kubelet\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-kubernetes\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081852    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-script-lib\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.083635 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081856    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3bdc6a-893c-458a-b3b5-88d95070e432-host\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-conf\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081876    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/898a7b93-f6d5-41ac-9d47-5e1261bca15b-tmp-dir\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d8db85-7e8e-4950-b3bd-6660e869cd06-host-var-lib-kubelet\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-lib-modules\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-tmp\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-os-release\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082002    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/600f989a-9562-4e79-82d5-09b6cf866d66-ovnkube-config\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.081993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082080    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e070bbb3-86d8-4ce0-85e9-a06580b82315-os-release\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7v4k\" (UniqueName: \"kubernetes.io/projected/e070bbb3-86d8-4ce0-85e9-a06580b82315-kube-api-access-k7v4k\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-bin\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhg4n\" (UniqueName: \"kubernetes.io/projected/277062f5-9c5f-481f-9996-f84bea6e506b-kube-api-access-lhg4n\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwnb\" (UniqueName: \"kubernetes.io/projected/600f989a-9562-4e79-82d5-09b6cf866d66-kube-api-access-xmwnb\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082278    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-bin\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3731445d-3047-4c7e-bd3e-5e107723fcb0-agent-certs\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-systemd\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.084165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrj8j\" (UniqueName: \"kubernetes.io/projected/59a6aaca-045b-40b0-bac6-7c869ec4232c-kube-api-access-wrj8j\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-ovn\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-device-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082450    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-run-ovn\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082457    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e070bbb3-86d8-4ce0-85e9-a06580b82315-cni-binary-copy\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.082513    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-iptables-alerter-script\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.082565    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:48.582550595 +0000 UTC m=+1.980548906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-netd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082620    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/600f989a-9562-4e79-82d5-09b6cf866d66-host-cni-netd\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/600f989a-9562-4e79-82d5-09b6cf866d66-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/898a7b93-f6d5-41ac-9d47-5e1261bca15b-hosts-file\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpm68\" (UniqueName: \"kubernetes.io/projected/898a7b93-f6d5-41ac-9d47-5e1261bca15b-kube-api-access-hpm68\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.084664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082719    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/898a7b93-f6d5-41ac-9d47-5e1261bca15b-hosts-file\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.085130 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.082935    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 02:14:48.085130 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.083005    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-iptables-alerter-script\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.085819 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.085800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/600f989a-9562-4e79-82d5-09b6cf866d66-ovn-node-metrics-cert\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.085935 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.085918    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3731445d-3047-4c7e-bd3e-5e107723fcb0-agent-certs\") pod \"konnectivity-agent-fd69w\" (UID: \"3731445d-3047-4c7e-bd3e-5e107723fcb0\") " pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:48.088555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.088537    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqdd\" (UniqueName: \"kubernetes.io/projected/eb3bdc6a-893c-458a-b3b5-88d95070e432-kube-api-access-5nqdd\") pod \"node-ca-68szx\" (UID: \"eb3bdc6a-893c-458a-b3b5-88d95070e432\") " pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.089869 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.089843    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:48.089869 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.089871    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:48.090058 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.089885    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:48.090058 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.089945    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:48.58992736 +0000 UTC m=+1.987925691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:48.090276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.090181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hmg\" (UniqueName: \"kubernetes.io/projected/47d8db85-7e8e-4950-b3bd-6660e869cd06-kube-api-access-98hmg\") pod \"multus-gwdld\" (UID: \"47d8db85-7e8e-4950-b3bd-6660e869cd06\") " pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.090969 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.090944    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbjz\" (UniqueName: \"kubernetes.io/projected/44b9fe51-e7c0-48f0-81ee-5a5f8de27625-kube-api-access-vvbjz\") pod \"iptables-alerter-fgg7p\" (UID: \"44b9fe51-e7c0-48f0-81ee-5a5f8de27625\") " pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.091117 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.091095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpt6\" (UniqueName: \"kubernetes.io/projected/1254f3fd-6b88-4183-8fd3-6012e6d6c751-kube-api-access-2hpt6\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:48.092026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.092003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwnb\" (UniqueName: \"kubernetes.io/projected/600f989a-9562-4e79-82d5-09b6cf866d66-kube-api-access-xmwnb\") pod \"ovnkube-node-nn6nm\" (UID: \"600f989a-9562-4e79-82d5-09b6cf866d66\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.092201 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.092184    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7v4k\" (UniqueName: \"kubernetes.io/projected/e070bbb3-86d8-4ce0-85e9-a06580b82315-kube-api-access-k7v4k\") pod \"multus-additional-cni-plugins-sk56z\" (UID: \"e070bbb3-86d8-4ce0-85e9-a06580b82315\") " pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.092313 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.092296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpm68\" (UniqueName: \"kubernetes.io/projected/898a7b93-f6d5-41ac-9d47-5e1261bca15b-kube-api-access-hpm68\") pod \"node-resolver-x47k6\" (UID: \"898a7b93-f6d5-41ac-9d47-5e1261bca15b\") " pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.182988 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.182955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-kubernetes\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.182988 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.182988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-conf\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.182988 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-lib-modules\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-tmp\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhg4n\" (UniqueName: \"kubernetes.io/projected/277062f5-9c5f-481f-9996-f84bea6e506b-kube-api-access-lhg4n\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-systemd\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrj8j\" (UniqueName: \"kubernetes.io/projected/59a6aaca-045b-40b0-bac6-7c869ec4232c-kube-api-access-wrj8j\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-device-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183099    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-kubernetes\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183159    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-systemd\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183166    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-device-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183182    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-conf\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183184    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-lib-modules\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183258    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-sys\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-registration-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.183306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183321    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-sys\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysconfig\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183366    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-registration-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-var-lib-kubelet\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183417    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysconfig\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-socket-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183490    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-var-lib-kubelet\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183415    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183509    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-sysctl-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183524    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-socket-dir\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-modprobe-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-tuned\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-host\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-sys-fs\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183665    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/277062f5-9c5f-481f-9996-f84bea6e506b-sys-fs\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.184011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183669    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-host\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184485 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183679    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-modprobe-d\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184485 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-run\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.184485 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.183909    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59a6aaca-045b-40b0-bac6-7c869ec4232c-run\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.185296 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.185276    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-tmp\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.185674 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.185657    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59a6aaca-045b-40b0-bac6-7c869ec4232c-etc-tuned\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.202571 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.202527    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhg4n\" (UniqueName: \"kubernetes.io/projected/277062f5-9c5f-481f-9996-f84bea6e506b-kube-api-access-lhg4n\") pod \"aws-ebs-csi-driver-node-r6d9p\" (UID: \"277062f5-9c5f-481f-9996-f84bea6e506b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.203195 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.203174    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrj8j\" (UniqueName: \"kubernetes.io/projected/59a6aaca-045b-40b0-bac6-7c869ec4232c-kube-api-access-wrj8j\") pod \"tuned-dhtcv\" (UID: \"59a6aaca-045b-40b0-bac6-7c869ec4232c\") " pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.278255 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.278225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68szx"
Jul 07 02:14:48.303073 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.303039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sk56z"
Jul 07 02:14:48.330150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.330129    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:14:48.335167 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.335141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73221a191ca5c147b7930be3913f71c2.slice/crio-817d72eb9fd40df5e21eb2cf89efe59c754c416e8e74d17d66d0a4ad79af983f WatchSource:0}: Error finding container 817d72eb9fd40df5e21eb2cf89efe59c754c416e8e74d17d66d0a4ad79af983f: Status 404 returned error can't find the container with id 817d72eb9fd40df5e21eb2cf89efe59c754c416e8e74d17d66d0a4ad79af983f
Jul 07 02:14:48.335767 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.335748    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ce01185dfdcbc31d8e5ab0d9274554.slice/crio-0a07be54f7d6da3c34adbaac1a9213384e37247522645e39aa67e652ad727a36 WatchSource:0}: Error finding container 0a07be54f7d6da3c34adbaac1a9213384e37247522645e39aa67e652ad727a36: Status 404 returned error can't find the container with id 0a07be54f7d6da3c34adbaac1a9213384e37247522645e39aa67e652ad727a36
Jul 07 02:14:48.339973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.339955    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:14:48.340297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.340263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:14:48.341214 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.341194    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600f989a_9562_4e79_82d5_09b6cf866d66.slice/crio-ee656f2263de5effdf47ee8ab00886bfedf77e9b2e2bd2a6495851427b6b9afd WatchSource:0}: Error finding container ee656f2263de5effdf47ee8ab00886bfedf77e9b2e2bd2a6495851427b6b9afd: Status 404 returned error can't find the container with id ee656f2263de5effdf47ee8ab00886bfedf77e9b2e2bd2a6495851427b6b9afd
Jul 07 02:14:48.347556 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.347535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x47k6"
Jul 07 02:14:48.349452 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.349433    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3731445d_3047_4c7e_bd3e_5e107723fcb0.slice/crio-cf846d1660b16ac73b2f8e763e4f087385b3eae758a4a96c4d34604000e42cf0 WatchSource:0}: Error finding container cf846d1660b16ac73b2f8e763e4f087385b3eae758a4a96c4d34604000e42cf0: Status 404 returned error can't find the container with id cf846d1660b16ac73b2f8e763e4f087385b3eae758a4a96c4d34604000e42cf0
Jul 07 02:14:48.355287 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.355263    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod898a7b93_f6d5_41ac_9d47_5e1261bca15b.slice/crio-15b3744876b568225b18669b112f534ed03db50d5d6984fa5147814789d0494a WatchSource:0}: Error finding container 15b3744876b568225b18669b112f534ed03db50d5d6984fa5147814789d0494a: Status 404 returned error can't find the container with id 15b3744876b568225b18669b112f534ed03db50d5d6984fa5147814789d0494a
Jul 07 02:14:48.371320 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.371294    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gwdld"
Jul 07 02:14:48.375887 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.375869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fgg7p"
Jul 07 02:14:48.379280 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.379256    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d8db85_7e8e_4950_b3bd_6660e869cd06.slice/crio-321f03151de04dcac11ccc57b1e4765c8c2457620494f4ac2f1fbb81fce6566b WatchSource:0}: Error finding container 321f03151de04dcac11ccc57b1e4765c8c2457620494f4ac2f1fbb81fce6566b: Status 404 returned error can't find the container with id 321f03151de04dcac11ccc57b1e4765c8c2457620494f4ac2f1fbb81fce6566b
Jul 07 02:14:48.383928 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.383908    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b9fe51_e7c0_48f0_81ee_5a5f8de27625.slice/crio-921a4382195066654d1bb3f4a13ee1c6cc02c490eec9672c478bcfc3015fa3e9 WatchSource:0}: Error finding container 921a4382195066654d1bb3f4a13ee1c6cc02c490eec9672c478bcfc3015fa3e9: Status 404 returned error can't find the container with id 921a4382195066654d1bb3f4a13ee1c6cc02c490eec9672c478bcfc3015fa3e9
Jul 07 02:14:48.401969 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.401948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p"
Jul 07 02:14:48.407252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.407230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhtcv"
Jul 07 02:14:48.410857 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.410836    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277062f5_9c5f_481f_9996_f84bea6e506b.slice/crio-c551bce445c2955d858f862e9196c6930a819f79ba4eb237d1e7d5ff44916257 WatchSource:0}: Error finding container c551bce445c2955d858f862e9196c6930a819f79ba4eb237d1e7d5ff44916257: Status 404 returned error can't find the container with id c551bce445c2955d858f862e9196c6930a819f79ba4eb237d1e7d5ff44916257
Jul 07 02:14:48.415475 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.415452    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a6aaca_045b_40b0_bac6_7c869ec4232c.slice/crio-e3bf7dda2e5a2108d056a3761ad15478c5e8261ca7aa9c7dad595a0a7d389e94 WatchSource:0}: Error finding container e3bf7dda2e5a2108d056a3761ad15478c5e8261ca7aa9c7dad595a0a7d389e94: Status 404 returned error can't find the container with id e3bf7dda2e5a2108d056a3761ad15478c5e8261ca7aa9c7dad595a0a7d389e94
Jul 07 02:14:48.550441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.550349    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:48.587282 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.587238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:48.587282 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.587289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:48.587486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.587391    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:48.587486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.587393    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:48.587486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.587450    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.587434321 +0000 UTC m=+2.985432633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:48.587486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.587464    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.587457587 +0000 UTC m=+2.985455896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:48.687831 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.687794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:48.687990 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.687943    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:48.687990 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.687958    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:48.687990 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.687967    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:48.688088 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:48.688021    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:49.688004017 +0000 UTC m=+3.086002341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:48.708223 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.708188    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode070bbb3_86d8_4ce0_85e9_a06580b82315.slice/crio-91ccec0029ef71c8bd3a35bb8169fdaaac133760778a0fe6feec4d95bc43dae2 WatchSource:0}: Error finding container 91ccec0029ef71c8bd3a35bb8169fdaaac133760778a0fe6feec4d95bc43dae2: Status 404 returned error can't find the container with id 91ccec0029ef71c8bd3a35bb8169fdaaac133760778a0fe6feec4d95bc43dae2
Jul 07 02:14:48.709201 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:14:48.709174    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3bdc6a_893c_458a_b3b5_88d95070e432.slice/crio-e249762a707e65f4770b439e40eeb685a1678f5b42e312d1e81fb42804fc74ed WatchSource:0}: Error finding container e249762a707e65f4770b439e40eeb685a1678f5b42e312d1e81fb42804fc74ed: Status 404 returned error can't find the container with id e249762a707e65f4770b439e40eeb685a1678f5b42e312d1e81fb42804fc74ed
Jul 07 02:14:48.774511 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:48.774478    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:49.070979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.070923    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:09:48 +0000 UTC" deadline="2028-01-16 19:03:44.314459105 +0000 UTC"
Jul 07 02:14:49.070979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.070977    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13408h48m55.243487398s"
Jul 07 02:14:49.150231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.150066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:49.150231 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.150196    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:49.169496 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.169431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal" event={"ID":"73221a191ca5c147b7930be3913f71c2","Type":"ContainerStarted","Data":"817d72eb9fd40df5e21eb2cf89efe59c754c416e8e74d17d66d0a4ad79af983f"}
Jul 07 02:14:49.184225 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.184181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhtcv" event={"ID":"59a6aaca-045b-40b0-bac6-7c869ec4232c","Type":"ContainerStarted","Data":"e3bf7dda2e5a2108d056a3761ad15478c5e8261ca7aa9c7dad595a0a7d389e94"}
Jul 07 02:14:49.187590 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.187551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p" event={"ID":"277062f5-9c5f-481f-9996-f84bea6e506b","Type":"ContainerStarted","Data":"c551bce445c2955d858f862e9196c6930a819f79ba4eb237d1e7d5ff44916257"}
Jul 07 02:14:49.193833 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.193797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgg7p" event={"ID":"44b9fe51-e7c0-48f0-81ee-5a5f8de27625","Type":"ContainerStarted","Data":"921a4382195066654d1bb3f4a13ee1c6cc02c490eec9672c478bcfc3015fa3e9"}
Jul 07 02:14:49.196543 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.196516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwdld" event={"ID":"47d8db85-7e8e-4950-b3bd-6660e869cd06","Type":"ContainerStarted","Data":"321f03151de04dcac11ccc57b1e4765c8c2457620494f4ac2f1fbb81fce6566b"}
Jul 07 02:14:49.199950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.199919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x47k6" event={"ID":"898a7b93-f6d5-41ac-9d47-5e1261bca15b","Type":"ContainerStarted","Data":"15b3744876b568225b18669b112f534ed03db50d5d6984fa5147814789d0494a"}
Jul 07 02:14:49.204573 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.204498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fd69w" event={"ID":"3731445d-3047-4c7e-bd3e-5e107723fcb0","Type":"ContainerStarted","Data":"cf846d1660b16ac73b2f8e763e4f087385b3eae758a4a96c4d34604000e42cf0"}
Jul 07 02:14:49.207998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.207917    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal" event={"ID":"b0ce01185dfdcbc31d8e5ab0d9274554","Type":"ContainerStarted","Data":"0a07be54f7d6da3c34adbaac1a9213384e37247522645e39aa67e652ad727a36"}
Jul 07 02:14:49.209446 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.209353    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68szx" event={"ID":"eb3bdc6a-893c-458a-b3b5-88d95070e432","Type":"ContainerStarted","Data":"e249762a707e65f4770b439e40eeb685a1678f5b42e312d1e81fb42804fc74ed"}
Jul 07 02:14:49.211666 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.211566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerStarted","Data":"91ccec0029ef71c8bd3a35bb8169fdaaac133760778a0fe6feec4d95bc43dae2"}
Jul 07 02:14:49.212844 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.212753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"ee656f2263de5effdf47ee8ab00886bfedf77e9b2e2bd2a6495851427b6b9afd"}
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.599761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.599837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.599970    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.600035    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:51.60001708 +0000 UTC m=+4.998015394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.600441    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.600542 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.600508    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:51.600478195 +0000 UTC m=+4.998476505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:49.701166 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.701128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:49.701350 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.701302    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:49.701350 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.701321    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:49.701350 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.701333    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:49.701515 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:49.701394    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:51.701375472 +0000 UTC m=+5.099373782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:49.733297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:49.733263    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 02:14:50.071163 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:50.071104    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 02:09:48 +0000 UTC" deadline="2028-02-24 07:01:16.430988368 +0000 UTC"
Jul 07 02:14:50.071163 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:50.071156    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14332h46m26.359834452s"
Jul 07 02:14:50.148176 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:50.148147    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:50.148447 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:50.148266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:50.148663 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:50.148645    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:50.148742 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:50.148726    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:51.150501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:51.150469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:51.150999 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.150592    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:51.618998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:51.618961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:51.619203 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:51.619030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:51.619203 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.619193    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:51.619312 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.619256    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:55.619238229 +0000 UTC m=+9.017236561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:51.619712 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.619683    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:51.619807 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.619741    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:55.6197252 +0000 UTC m=+9.017723513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:51.720331 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:51.720283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:51.720525 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.720510    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:51.720600 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.720527    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:51.720600 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.720541    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:51.720600 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:51.720599    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:14:55.72058073 +0000 UTC m=+9.118579060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:52.148873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:52.148179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:52.148873 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:52.148315    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:52.148873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:52.148708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:52.148873 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:52.148808    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:53.148540 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:53.148505    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:53.149018 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:53.148700    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:54.149103 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:54.149066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:54.149544 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:54.149077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:54.149544 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:54.149208    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:54.149544 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:54.149305    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:55.148721 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:55.148514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:55.148897 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.148804    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:55.655393 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:55.655353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:55.655898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:55.655424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:55.655898 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.655541    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:55.655898 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.655581    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:55.655898 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.655638    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:03.655597086 +0000 UTC m=+17.053595400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:14:55.655898 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.655666    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:03.655646772 +0000 UTC m=+17.053645088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:14:55.756109 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:55.756071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:55.756286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.756210    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:14:55.756286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.756224    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:14:55.756286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.756234    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:55.756286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:55.756286    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:03.756268019 +0000 UTC m=+17.154266328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:14:56.148212 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:56.148173    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:56.148385 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:56.148175    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:56.148385 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:56.148307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:56.148505 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:56.148388    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:57.149841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:57.149801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:57.150278 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:57.149915    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:14:58.148927 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:58.148849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:14:58.149081 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:58.148967    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:14:58.149285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:58.149257    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:14:58.149416 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:58.149341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:14:59.151071 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:14:59.151038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:14:59.151486 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:14:59.151157    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:00.148511 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:00.148469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:00.148707 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:00.148488    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:00.148707 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:00.148601    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:00.148820 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:00.148707    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:01.149389 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:01.148867    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:01.149389 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:01.149009    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:02.148421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:02.148383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:02.148627 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:02.148518    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:02.148627 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:02.148569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:02.148733 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:02.148704    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:03.148643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:03.148586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:03.149043 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.148742    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:03.717417 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:03.717371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:03.717636 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:03.717443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:03.717636 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.717546    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:03.717636 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.717547    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:03.717636 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.717627    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:19.717589667 +0000 UTC m=+33.115587983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:03.717867 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.717647    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:19.717636105 +0000 UTC m=+33.115634441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:03.818130 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:03.818093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:03.818311 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.818272    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:15:03.818311 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.818292    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:15:03.818311 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.818302    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:03.818429 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:03.818361    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:19.818342548 +0000 UTC m=+33.216340875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:04.149081 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:04.149039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:04.149554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:04.149039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:04.149554 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:04.149190    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:04.149554 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:04.149271    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:05.148378 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:05.148346    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:05.148563 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:05.148457    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:06.148939 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:06.148900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:06.149389 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:06.148900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:06.149389 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:06.149048    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:06.149389 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:06.149131    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:07.149285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:07.149239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:07.149773 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:07.149344    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:08.148407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:08.148361    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:08.148563 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:08.148418    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:08.148563 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:08.148503    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:08.148683 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:08.148590    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:09.148282 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.148258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:09.148823 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:09.148354    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:09.263331 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.263080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal" event={"ID":"b0ce01185dfdcbc31d8e5ab0d9274554","Type":"ContainerStarted","Data":"3c809c14944aaea53c8fd5748362f330b7ea7b5f75a2e61984e6c0556cc27c46"}
Jul 07 02:15:09.265467 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.265423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"c45f54c495874752a6b79a20c9cf9043e8db23c7c733f889d70466cbf402cf67"}
Jul 07 02:15:09.267167 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.267141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhtcv" event={"ID":"59a6aaca-045b-40b0-bac6-7c869ec4232c","Type":"ContainerStarted","Data":"bfc9319f366dab95da6118e2d8d5392d8b39377473cf8a1a089f77fde298c969"}
Jul 07 02:15:09.269252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.269230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gwdld" event={"ID":"47d8db85-7e8e-4950-b3bd-6660e869cd06","Type":"ContainerStarted","Data":"8bbfac9bbc687cde76bdbc018d277357ed109d77abb1e7aee116e82e80095f91"}
Jul 07 02:15:09.278712 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.278659    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-72.ec2.internal" podStartSLOduration=22.278642115 podStartE2EDuration="22.278642115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:09.27794446 +0000 UTC m=+22.675942791" watchObservedRunningTime="2026-07-07 02:15:09.278642115 +0000 UTC m=+22.676640446"
Jul 07 02:15:09.297596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.297511    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dhtcv" podStartSLOduration=1.668876311 podStartE2EDuration="22.297487594s" totalImagesPullingTime="20.628611283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:09.296287522 +0000 UTC m=+22.694285855" watchObservedRunningTime="2026-07-07 02:15:09.297487594 +0000 UTC m=+22.695485987"
Jul 07 02:15:09.312510 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:09.312462    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gwdld" podStartSLOduration=1.5876900379999999 podStartE2EDuration="22.31244819s" totalImagesPullingTime="20.724758152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:09.312361464 +0000 UTC m=+22.710359797" watchObservedRunningTime="2026-07-07 02:15:09.31244819 +0000 UTC m=+22.710446530"
Jul 07 02:15:10.149094 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.149068    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:10.149698 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:10.149180    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:10.149698 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.149236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:10.149698 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:10.149329    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:10.272697 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.272363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p" event={"ID":"277062f5-9c5f-481f-9996-f84bea6e506b","Type":"ContainerStarted","Data":"cedee4a0d2f2251e91a8ded6cb3c845a2bf363fc5d34dc91f2195bfd644bcc01"}
Jul 07 02:15:10.273785 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.273746    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x47k6" event={"ID":"898a7b93-f6d5-41ac-9d47-5e1261bca15b","Type":"ContainerStarted","Data":"2c3a69e1320a1d9079cc1c3657bd360bb02d05c15b19de6e09e9f5aaa0feda7c"}
Jul 07 02:15:10.275167 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.275140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fd69w" event={"ID":"3731445d-3047-4c7e-bd3e-5e107723fcb0","Type":"ContainerStarted","Data":"7fc14903e80255311f168cac346dc319a63a664edb9bd931104a7c2e98520d7a"}
Jul 07 02:15:10.276531 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.276511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68szx" event={"ID":"eb3bdc6a-893c-458a-b3b5-88d95070e432","Type":"ContainerStarted","Data":"5240c978a5bd4598a6f3b309c2f3b612c0b27684beb74c7a4d84ba71015bbe2a"}
Jul 07 02:15:10.278030 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.278007    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="3d2ad3be4ad9fac1d3e1a53133f2d2f96ce1de6c740c9f341ea1d606537687db" exitCode=0
Jul 07 02:15:10.278120 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.278078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"3d2ad3be4ad9fac1d3e1a53133f2d2f96ce1de6c740c9f341ea1d606537687db"}
Jul 07 02:15:10.281172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.281149    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"2b6757edf0aef9ce4a1988a20050190eb815c82c414d9340688c8bf5a719b556"}
Jul 07 02:15:10.281261 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.281209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"181e2d3ff6177b7ce90b327a608f10c9b4dd41fa3c927841ad5d2767f61d6276"}
Jul 07 02:15:10.281261 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.281249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"6a529e2b7a10196ce1e354de6759be121456cff2df3fb80cf540f3d65fc9f552"}
Jul 07 02:15:10.281368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.281279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"0096a40fafc14ce6d6f81587759998b8ee3c5d9f6a384223942a54d9375f28d1"}
Jul 07 02:15:10.281368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.281318    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"020b6b1a9bd2256dd09823b5ecbf2489849729bc498f4c1a9d83127d8518d830"}
Jul 07 02:15:10.282563 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.282530    2559 generic.go:356] "Generic (PLEG): container finished" podID="73221a191ca5c147b7930be3913f71c2" containerID="c1bc37f649394d44b50f84e2dbddafa860f55c214ccf3654e46beecf776cab92" exitCode=0
Jul 07 02:15:10.282654 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.282632    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal" event={"ID":"73221a191ca5c147b7930be3913f71c2","Type":"ContainerDied","Data":"c1bc37f649394d44b50f84e2dbddafa860f55c214ccf3654e46beecf776cab92"}
Jul 07 02:15:10.288195 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.288160    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x47k6" podStartSLOduration=2.599498519 podStartE2EDuration="23.288146818s" totalImagesPullingTime="20.688648299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:10.288127818 +0000 UTC m=+23.686126149" watchObservedRunningTime="2026-07-07 02:15:10.288146818 +0000 UTC m=+23.686145150"
Jul 07 02:15:10.303030 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.302983    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-68szx" podStartSLOduration=2.9680998560000003 podStartE2EDuration="23.302964047s" totalImagesPullingTime="20.334864191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:10.302133493 +0000 UTC m=+23.700131824" watchObservedRunningTime="2026-07-07 02:15:10.302964047 +0000 UTC m=+23.700962380"
Jul 07 02:15:10.317158 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.317118    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fd69w" podStartSLOduration=2.62343085 podStartE2EDuration="23.317103273s" totalImagesPullingTime="20.693672423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:10.316741852 +0000 UTC m=+23.714740178" watchObservedRunningTime="2026-07-07 02:15:10.317103273 +0000 UTC m=+23.715101795"
Jul 07 02:15:10.462229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.462195    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:15:10.462829 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:10.462809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:15:11.148304 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.148275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:11.148601 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:11.148410    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:11.289470 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.289431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal" event={"ID":"73221a191ca5c147b7930be3913f71c2","Type":"ContainerStarted","Data":"525e6ada8ec97c8ed5b4efa38adbd6347f3620a9dec693753c61bbd69bd954ac"}
Jul 07 02:15:11.290990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.290961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fgg7p" event={"ID":"44b9fe51-e7c0-48f0-81ee-5a5f8de27625","Type":"ContainerStarted","Data":"0113c411d9bfd0704ceccbfd2e6dd4e59453f26bbdc9aa2975648985a517c2a1"}
Jul 07 02:15:11.291492 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.291454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:15:11.291664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.291640    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fd69w"
Jul 07 02:15:11.304268 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.304222    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-72.ec2.internal" podStartSLOduration=24.304208607 podStartE2EDuration="24.304208607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.303962452 +0000 UTC m=+24.701960785" watchObservedRunningTime="2026-07-07 02:15:11.304208607 +0000 UTC m=+24.702206938"
Jul 07 02:15:11.664775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:11.664738    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 02:15:12.044359 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.044218    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T02:15:11.664757498Z","UUID":"7231d6e3-11ab-4f59-8bd5-075aca30735f","Handler":null,"Name":"","Endpoint":""}
Jul 07 02:15:12.046114 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.046084    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 02:15:12.046311 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.046127    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 02:15:12.148620 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.148569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:12.148792 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:12.148718    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:12.148792 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.148753    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:12.148879 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:12.148851    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:12.297729 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.297635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"80494ab7afe11901863175d028349bba2e00af43d37ecfeaa934a9168f80cac3"}
Jul 07 02:15:12.299443 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:12.299415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p" event={"ID":"277062f5-9c5f-481f-9996-f84bea6e506b","Type":"ContainerStarted","Data":"afa52092d69f3bdc3a8ebfaeac32bd36acb96a4138058a336d602dc72743dca5"}
Jul 07 02:15:13.148710 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:13.148688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:13.148838 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:13.148814    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:13.303898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:13.303853    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p" event={"ID":"277062f5-9c5f-481f-9996-f84bea6e506b","Type":"ContainerStarted","Data":"09d2597d44b2e7cffbae118420a5265c32b37ef82c25a1af404f2688b85fbff8"}
Jul 07 02:15:13.323829 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:13.323782    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fgg7p" podStartSLOduration=5.661788534 podStartE2EDuration="26.323766783s" totalImagesPullingTime="20.661978249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:11.333257107 +0000 UTC m=+24.731255439" watchObservedRunningTime="2026-07-07 02:15:13.323766783 +0000 UTC m=+26.721765116"
Jul 07 02:15:13.324002 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:13.323858    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6d9p" podStartSLOduration=2.897470296 podStartE2EDuration="26.323854039s" totalImagesPullingTime="23.426383743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:13.323480457 +0000 UTC m=+26.721478789" watchObservedRunningTime="2026-07-07 02:15:13.323854039 +0000 UTC m=+26.721852370"
Jul 07 02:15:14.148524 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:14.148497    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:14.148672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:14.148495    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:14.148672 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:14.148628    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:14.148749 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:14.148703    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:14.310161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:14.310086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" event={"ID":"600f989a-9562-4e79-82d5-09b6cf866d66","Type":"ContainerStarted","Data":"29280cfd87b109d7b510886855774cc4d3868205f130b3a9d1a3bbdd4aa79795"}
Jul 07 02:15:14.341931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:14.341879    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm" podStartSLOduration=6.5705340660000005 podStartE2EDuration="27.341861749s" totalImagesPullingTime="20.771327683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:14.341304454 +0000 UTC m=+27.739302781" watchObservedRunningTime="2026-07-07 02:15:14.341861749 +0000 UTC m=+27.739860082"
Jul 07 02:15:15.149058 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.148973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:15.149191 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:15.149090    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:15.314086 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.313882    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:15.314086 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.313974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:15.314086 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.314020    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:15.338534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.338500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:15.340172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:15.340137    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:16.149140 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.149111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:16.149140 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.149149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:16.149346 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:16.149227    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:16.149381 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:16.149355    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:16.251247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.251204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5s84"]
Jul 07 02:15:16.251393 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.251329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:16.251449 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:16.251411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:16.253797 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.253764    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sb67"]
Jul 07 02:15:16.257517 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.257493    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5z2q"]
Jul 07 02:15:16.315190 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.315160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:16.315190 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:16.315175    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:16.315750 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:16.315265    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:16.315845 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:16.315824    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:18.148828 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:18.148642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:18.149213 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:18.148680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:18.149213 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:18.148901    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:18.149213 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:18.148680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:18.149213 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:18.148972    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:18.149213 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:18.149038    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:19.323858 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:19.323822    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="98c78a831600e18158799f65c61aa3327f47003ad809946a79c4ac84e8241213" exitCode=0
Jul 07 02:15:19.324247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:19.323876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"98c78a831600e18158799f65c61aa3327f47003ad809946a79c4ac84e8241213"}
Jul 07 02:15:19.742842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:19.742812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:19.742978 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:19.742873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:19.742978 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.742969    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:19.743056 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.742970    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:19.743056 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.743021    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:51.743009056 +0000 UTC m=+65.141007366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 02:15:19.743056 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.743034    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret podName:9cdbf32e-b191-461f-9320-eeed64359999 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:51.743028681 +0000 UTC m=+65.141026991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret") pod "global-pull-secret-syncer-9sb67" (UID: "9cdbf32e-b191-461f-9320-eeed64359999") : object "kube-system"/"original-pull-secret" not registered
Jul 07 02:15:19.843975 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:19.843917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:19.844150 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.844079    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 02:15:19.844150 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.844118    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 02:15:19.844150 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.844131    2559 projected.go:196] Error preparing data for projected volume kube-api-access-2ms95 for pod openshift-network-diagnostics/network-check-target-q5s84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:19.844268 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:19.844198    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95 podName:afd45477-45d6-4be0-bd9b-d91917aceb53 nodeName:}" failed. No retries permitted until 2026-07-07 02:15:51.844180376 +0000 UTC m=+65.242178702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ms95" (UniqueName: "kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95") pod "network-check-target-q5s84" (UID: "afd45477-45d6-4be0-bd9b-d91917aceb53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 02:15:20.148366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:20.148331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:20.148366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:20.148351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:20.148559 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:20.148376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:20.148559 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:20.148492    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9sb67" podUID="9cdbf32e-b191-461f-9320-eeed64359999"
Jul 07 02:15:20.148687 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:20.148623    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5s84" podUID="afd45477-45d6-4be0-bd9b-d91917aceb53"
Jul 07 02:15:20.148741 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:20.148692    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:15:20.328721 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:20.328628    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="56501fc107242a73e5fd55e90da35b7a183301b7d7e593a3517c8a1b8c84d768" exitCode=0
Jul 07 02:15:20.328721 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:20.328691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"56501fc107242a73e5fd55e90da35b7a183301b7d7e593a3517c8a1b8c84d768"}
Jul 07 02:15:21.333128 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.333039    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="21e50847cfa6eb4bde759895ed5dc8ccab72f1a24e48451d4487092e8e15fe8c" exitCode=0
Jul 07 02:15:21.333128 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.333070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"21e50847cfa6eb4bde759895ed5dc8ccab72f1a24e48451d4487092e8e15fe8c"}
Jul 07 02:15:21.925914 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.925886    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-72.ec2.internal" event="NodeReady"
Jul 07 02:15:21.926159 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.926006    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 02:15:21.963444 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.963385    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"]
Jul 07 02:15:21.965653 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.965625    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:15:21.965785 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.965731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:21.967318 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.967300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:21.969208 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.969167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5jncd\""
Jul 07 02:15:21.969540 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.969521    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 02:15:21.970402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970187    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"]
Jul 07 02:15:21.970643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970594    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 02:15:21.970643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 02:15:21.970809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970694    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 02:15:21.970809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970706    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 02:15:21.970809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970779    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 02:15:21.970809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.970804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 02:15:21.971110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.971095    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pv7ql\""
Jul 07 02:15:21.972036 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.972001    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"]
Jul 07 02:15:21.972158 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.972124    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:21.973844 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.973825    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"]
Jul 07 02:15:21.973958 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.973937    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:21.975907 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.975888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:21.981183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.981137    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 02:15:21.981401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.981381    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 02:15:21.981593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.981575    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 02:15:21.981802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.981783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 02:15:21.982058 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.982039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 02:15:21.982438 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.982413    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sc5fj\""
Jul 07 02:15:21.982519 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.982504    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 02:15:21.982671 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.982648    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 02:15:21.983241 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.983217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"]
Jul 07 02:15:21.986044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.986014    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:15:21.986236 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.986078    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 02:15:21.988973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.988953    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"]
Jul 07 02:15:21.989619 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.989584    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dxmtt"]
Jul 07 02:15:21.992675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.992656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:21.995668 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.995647    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 02:15:21.995773 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.995707    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 02:15:21.996438 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.996375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\""
Jul 07 02:15:21.997995 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:21.997975    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsq5"]
Jul 07 02:15:22.000568 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.000548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"]
Jul 07 02:15:22.000696 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.000679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.004029 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.003989    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 02:15:22.004262 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.004247    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 02:15:22.004508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.004493    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 02:15:22.004805 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.004787    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpvcs\""
Jul 07 02:15:22.004958 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.004936    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"]
Jul 07 02:15:22.005051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.004985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxmtt"]
Jul 07 02:15:22.010114 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.010090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsq5"]
Jul 07 02:15:22.060371 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2f109-f553-41bd-8b54-6f75a30740a2-tmp\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.060371 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49hh9\" (UniqueName: \"kubernetes.io/projected/49b2f109-f553-41bd-8b54-6f75a30740a2-kube-api-access-49hh9\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrgsw\" (UniqueName: \"kubernetes.io/projected/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-kube-api-access-nrgsw\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq6p9\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b2f109-f553-41bd-8b54-6f75a30740a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.060967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.060967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.060967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.060759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.148197 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.148159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:22.148197 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.148185    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:22.148462 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.148186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:22.151246 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151221    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:15:22.151400 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151319    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:15:22.151400 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151342    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:15:22.151515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151429    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:15:22.151515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151498    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\""
Jul 07 02:15:22.151633 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.151584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\""
Jul 07 02:15:22.161043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.161170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-config-volume\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.161170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b2f109-f553-41bd-8b54-6f75a30740a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.161170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.161170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-cert\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.161170 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.161153    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.161224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:22.661205978 +0000 UTC m=+36.059204297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-tmp-dir\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2f109-f553-41bd-8b54-6f75a30740a2-tmp\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.161407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49hh9\" (UniqueName: \"kubernetes.io/projected/49b2f109-f553-41bd-8b54-6f75a30740a2-kube-api-access-49hh9\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtz6d\" (UniqueName: \"kubernetes.io/projected/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-kube-api-access-qtz6d\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq6p9\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161579    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfnp\" (UniqueName: \"kubernetes.io/projected/1237f1b7-6839-438f-a280-01457f79c1d0-kube-api-access-qmfnp\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrgsw\" (UniqueName: \"kubernetes.io/projected/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-kube-api-access-nrgsw\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1237f1b7-6839-438f-a280-01457f79c1d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.161824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161850    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49b2f109-f553-41bd-8b54-6f75a30740a2-tmp\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wf9\" (UniqueName: \"kubernetes.io/projected/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-kube-api-access-s9wf9\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.161901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.162055    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:22.162441 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.162080    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:22.166309 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.163025    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:22.663000203 +0000 UTC m=+36.060998526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:22.166309 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.164747    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.166309 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.164811    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.166309 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.165387    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.167232 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.167198    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/49b2f109-f553-41bd-8b54-6f75a30740a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.168242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.167863    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.168242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.167987    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.170643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.168686    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.170643 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.169229    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.174378 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.174352    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrgsw\" (UniqueName: \"kubernetes.io/projected/035a8a42-54e7-4a2c-bd9a-a9690ad6915d-kube-api-access-nrgsw\") pod \"managed-serviceaccount-addon-agent-5f4869998d-pb9mz\" (UID: \"035a8a42-54e7-4a2c-bd9a-a9690ad6915d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.174510 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.174478    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq6p9\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.175830 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.175793    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49hh9\" (UniqueName: \"kubernetes.io/projected/49b2f109-f553-41bd-8b54-6f75a30740a2-kube-api-access-49hh9\") pod \"klusterlet-addon-workmgr-756dd4ddb7-qfz44\" (UID: \"49b2f109-f553-41bd-8b54-6f75a30740a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.178896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.178687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fd69w_3731445d-3047-4c7e-bd3e-5e107723fcb0/konnectivity-agent/0.log" limit=1024
Jul 07 02:15:22.181200 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.181173    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.263297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.263478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtz6d\" (UniqueName: \"kubernetes.io/projected/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-kube-api-access-qtz6d\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.263694 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.263781 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfnp\" (UniqueName: \"kubernetes.io/projected/1237f1b7-6839-438f-a280-01457f79c1d0-kube-api-access-qmfnp\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.263781 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1237f1b7-6839-438f-a280-01457f79c1d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.263885 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.263885 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.263814    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:22.263885 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wf9\" (UniqueName: \"kubernetes.io/projected/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-kube-api-access-s9wf9\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.263885 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.263882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:22.763861367 +0000 UTC m=+36.161859681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:22.264083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.264083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.263984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-config-volume\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.264083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.264083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-cert\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.264269 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-tmp-dir\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.264405 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264375    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-tmp-dir\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.264676 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-config-volume\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.264766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.264749    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1237f1b7-6839-438f-a280-01457f79c1d0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.267087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.267061    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.267216 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.267193    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.267278 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.267262    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.267490 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.267468    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-cert\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.267896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.267870    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1237f1b7-6839-438f-a280-01457f79c1d0-ca\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.280108 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.280080    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wf9\" (UniqueName: \"kubernetes.io/projected/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-kube-api-access-s9wf9\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.280243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.280123    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtz6d\" (UniqueName: \"kubernetes.io/projected/a53ca3f8-8ba1-424a-a78d-12c0466ddcbd-kube-api-access-qtz6d\") pod \"ingress-canary-bfsq5\" (UID: \"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd\") " pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.280243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.280145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfnp\" (UniqueName: \"kubernetes.io/projected/1237f1b7-6839-438f-a280-01457f79c1d0-kube-api-access-qmfnp\") pod \"cluster-proxy-proxy-agent-59c787f568-986ph\" (UID: \"1237f1b7-6839-438f-a280-01457f79c1d0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.286972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.286948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:15:22.312249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.312215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:22.330424 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.330392    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:15:22.340052 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.339843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfsq5"
Jul 07 02:15:22.501731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.501682    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"]
Jul 07 02:15:22.510467 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:22.510437    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod035a8a42_54e7_4a2c_bd9a_a9690ad6915d.slice/crio-46ca3f7bad60f6e739f4e786bd2a3bba3c4490dec03442fd8224d1d7db69c409 WatchSource:0}: Error finding container 46ca3f7bad60f6e739f4e786bd2a3bba3c4490dec03442fd8224d1d7db69c409: Status 404 returned error can't find the container with id 46ca3f7bad60f6e739f4e786bd2a3bba3c4490dec03442fd8224d1d7db69c409
Jul 07 02:15:22.532065 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.532034    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"]
Jul 07 02:15:22.536119 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:22.536092    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1237f1b7_6839_438f_a280_01457f79c1d0.slice/crio-a5f0ea15760145f604aa5db8fd1aee2ef1e50322dd3ee81875d023b05c5e2784 WatchSource:0}: Error finding container a5f0ea15760145f604aa5db8fd1aee2ef1e50322dd3ee81875d023b05c5e2784: Status 404 returned error can't find the container with id a5f0ea15760145f604aa5db8fd1aee2ef1e50322dd3ee81875d023b05c5e2784
Jul 07 02:15:22.539504 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.539481    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"]
Jul 07 02:15:22.543898 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:22.543873    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b2f109_f553_41bd_8b54_6f75a30740a2.slice/crio-6b0bc6f711b3b20ff1564f59b0d09233fb927109d7b76a968db930602a916558 WatchSource:0}: Error finding container 6b0bc6f711b3b20ff1564f59b0d09233fb927109d7b76a968db930602a916558: Status 404 returned error can't find the container with id 6b0bc6f711b3b20ff1564f59b0d09233fb927109d7b76a968db930602a916558
Jul 07 02:15:22.544318 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.544299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfsq5"]
Jul 07 02:15:22.547029 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:22.547004    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53ca3f8_8ba1_424a_a78d_12c0466ddcbd.slice/crio-390be25d491e264b9e464cea1e8c61909b6cc5f57f0ff71db6d0eebb181f9031 WatchSource:0}: Error finding container 390be25d491e264b9e464cea1e8c61909b6cc5f57f0ff71db6d0eebb181f9031: Status 404 returned error can't find the container with id 390be25d491e264b9e464cea1e8c61909b6cc5f57f0ff71db6d0eebb181f9031
Jul 07 02:15:22.672193 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.671992    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:22.672193 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.672176    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:22.672193 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.672204    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:22.672444 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.672237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:22.672444 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.672266    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:23.672245854 +0000 UTC m=+37.070244186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:22.672444 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.672312    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:22.672444 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.672360    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:23.672346176 +0000 UTC m=+37.070344502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:22.773294 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:22.773258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:22.773499 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.773443    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:22.773564 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:22.773520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:23.773500402 +0000 UTC m=+37.171498714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:23.351711 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.351585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfsq5" event={"ID":"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd","Type":"ContainerStarted","Data":"390be25d491e264b9e464cea1e8c61909b6cc5f57f0ff71db6d0eebb181f9031"}
Jul 07 02:15:23.354202 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.354116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerStarted","Data":"a5f0ea15760145f604aa5db8fd1aee2ef1e50322dd3ee81875d023b05c5e2784"}
Jul 07 02:15:23.357579 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.357500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerStarted","Data":"6b0bc6f711b3b20ff1564f59b0d09233fb927109d7b76a968db930602a916558"}
Jul 07 02:15:23.360530 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.360464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerStarted","Data":"46ca3f7bad60f6e739f4e786bd2a3bba3c4490dec03442fd8224d1d7db69c409"}
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.686635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.686721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.686882    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.686950    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:25.68693049 +0000 UTC m=+39.084928813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.687484    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.687502    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:23.687701 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.687554    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:25.6875366 +0000 UTC m=+39.085534935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:23.788765 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:23.788186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:23.788765 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.788332    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:23.788765 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:23.788395    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:25.788376384 +0000 UTC m=+39.186374696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:25.706345 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:25.706307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:25.706412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.706481    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.706515    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.706528    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.706564    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:29.706542276 +0000 UTC m=+43.104540593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:25.706837 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.706586    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:29.706575273 +0000 UTC m=+43.104573587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:25.807793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:25.807752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:25.807960 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.807943    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:25.808032 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:25.808011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:29.807992466 +0000 UTC m=+43.205990791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:29.743451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:29.743409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:29.743479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.743586    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.743627    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.743669    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.743708    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:37.743681479 +0000 UTC m=+51.141679808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:29.743920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.743734    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:37.743715429 +0000 UTC m=+51.141713751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:29.844428 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:29.844378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:29.844664 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.844528    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:29.844664 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:29.844623    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:37.844584583 +0000 UTC m=+51.242582908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:33.392580 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.392547    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="f35d227330aceede7feb616ddf2a614eb06e7007c9f63d60407bb081f01427e7" exitCode=0
Jul 07 02:15:33.393090 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.392641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"f35d227330aceede7feb616ddf2a614eb06e7007c9f63d60407bb081f01427e7"}
Jul 07 02:15:33.394210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.394185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfsq5" event={"ID":"a53ca3f8-8ba1-424a-a78d-12c0466ddcbd","Type":"ContainerStarted","Data":"06892a274b2c3c5c7b383b1f8f81e19e58004271edd0551dbc010662cd9364a6"}
Jul 07 02:15:33.396150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.396124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerStarted","Data":"7bd98648fa375f69b9e5a23e8f16daf17c1ecea0d4195afd4c0a7beb5c8067ed"}
Jul 07 02:15:33.396260 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.396161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerStarted","Data":"3bd344d989197957818294a8f54f79818f959b49f2fc8e2d9c02f9cb5884360d"}
Jul 07 02:15:33.396260 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.396180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerStarted","Data":"0e9046d57f450bffe97d74780e1acdb9cad260b4a9b69970899da36998ca04aa"}
Jul 07 02:15:33.397554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.397533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerStarted","Data":"daae365f6bdfc706d3e3688df4255504ab679c34380addbaf2150d6587208d2d"}
Jul 07 02:15:33.397684 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.397583    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:33.399161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.399134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerStarted","Data":"07ae8f7e23b31d923e921d868d8d616625527998aa2d0d10468dc48ac9b285ad"}
Jul 07 02:15:33.399708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.399692    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:15:33.449459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.449390    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bfsq5" podStartSLOduration=2.5495258400000003 podStartE2EDuration="12.449368286s" totalImagesPullingTime="9.899842446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:33.449090733 +0000 UTC m=+46.847089065" watchObservedRunningTime="2026-07-07 02:15:33.449368286 +0000 UTC m=+46.847366619"
Jul 07 02:15:33.449814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.449770    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" podStartSLOduration=9.522003331 podStartE2EDuration="19.449758109s" totalImagesPullingTime="9.927754778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:33.433344016 +0000 UTC m=+46.831342349" watchObservedRunningTime="2026-07-07 02:15:33.449758109 +0000 UTC m=+46.847756442"
Jul 07 02:15:33.492192 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.492134    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" podStartSLOduration=9.589269034 podStartE2EDuration="19.492111564s" totalImagesPullingTime="9.90284253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:33.490879159 +0000 UTC m=+46.888877492" watchObservedRunningTime="2026-07-07 02:15:33.492111564 +0000 UTC m=+46.890109897"
Jul 07 02:15:33.514263 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:33.514206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" podStartSLOduration=9.578532642999999 podStartE2EDuration="19.51418906s" totalImagesPullingTime="9.935656417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:33.513769031 +0000 UTC m=+46.911767366" watchObservedRunningTime="2026-07-07 02:15:33.51418906 +0000 UTC m=+46.912187440"
Jul 07 02:15:34.404766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:34.404729    2559 generic.go:356] "Generic (PLEG): container finished" podID="e070bbb3-86d8-4ce0-85e9-a06580b82315" containerID="915ab3ff712c8ca924006848c341c6eeacf86d6c399b0baa13ea1949500d843a" exitCode=0
Jul 07 02:15:34.405241 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:34.404870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerDied","Data":"915ab3ff712c8ca924006848c341c6eeacf86d6c399b0baa13ea1949500d843a"}
Jul 07 02:15:35.412356 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:35.412320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sk56z" event={"ID":"e070bbb3-86d8-4ce0-85e9-a06580b82315","Type":"ContainerStarted","Data":"503aa2848549398d11c6a09eff545ae6981ad22036a109b43a8c7cb6fe2251b5"}
Jul 07 02:15:35.438448 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:35.438396    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sk56z" podStartSLOduration=7.334513831 podStartE2EDuration="48.438380144s" totalImagesPullingTime="41.103866313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:35.43756452 +0000 UTC m=+48.835562854" watchObservedRunningTime="2026-07-07 02:15:35.438380144 +0000 UTC m=+48.836378476"
Jul 07 02:15:37.809238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:37.809190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:37.809291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.809345    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.809385    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.809397    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.809423    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:15:53.809408422 +0000 UTC m=+67.207406734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:37.809692 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.809441    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:15:53.809433662 +0000 UTC m=+67.207431972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:37.909907 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:37.909869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:37.910088 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.909985    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:37.910088 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:37.910039    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:15:53.910025345 +0000 UTC m=+67.308023654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:47.329452 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:47.329409    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn6nm"
Jul 07 02:15:51.822930 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.822884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:51.823348 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.822951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:15:51.826352 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.826330    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 02:15:51.826423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.826333    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 02:15:51.833976 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:51.833951    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:15:51.834039 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:51.834029    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:16:55.834010034 +0000 UTC m=+129.232008346 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : secret "metrics-daemon-secret" not found
Jul 07 02:15:51.837171 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.837147    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cdbf32e-b191-461f-9320-eeed64359999-original-pull-secret\") pod \"global-pull-secret-syncer-9sb67\" (UID: \"9cdbf32e-b191-461f-9320-eeed64359999\") " pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:51.892242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.892205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9sb67"
Jul 07 02:15:51.923355 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.923320    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:51.926683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.926658    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 02:15:51.937152 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.937126    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 02:15:51.950536 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:51.950506    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ms95\" (UniqueName: \"kubernetes.io/projected/afd45477-45d6-4be0-bd9b-d91917aceb53-kube-api-access-2ms95\") pod \"network-check-target-q5s84\" (UID: \"afd45477-45d6-4be0-bd9b-d91917aceb53\") " pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:52.020531 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.020498    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9sb67"]
Jul 07 02:15:52.023303 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:52.023274    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdbf32e_b191_461f_9320_eeed64359999.slice/crio-6dea44d6d6d7068d7703d26990f361752819bfbe22dc956d96378c034782f7dd WatchSource:0}: Error finding container 6dea44d6d6d7068d7703d26990f361752819bfbe22dc956d96378c034782f7dd: Status 404 returned error can't find the container with id 6dea44d6d6d7068d7703d26990f361752819bfbe22dc956d96378c034782f7dd
Jul 07 02:15:52.200873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.200797    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rj5t\""
Jul 07 02:15:52.208348 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.208313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:52.339164 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.339131    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5s84"]
Jul 07 02:15:52.342906 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:15:52.342880    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd45477_45d6_4be0_bd9b_d91917aceb53.slice/crio-abde063e2ebec20292e792fec45e97b04a16fe6aafc2c6c17dc8c4f940d704a8 WatchSource:0}: Error finding container abde063e2ebec20292e792fec45e97b04a16fe6aafc2c6c17dc8c4f940d704a8: Status 404 returned error can't find the container with id abde063e2ebec20292e792fec45e97b04a16fe6aafc2c6c17dc8c4f940d704a8
Jul 07 02:15:52.465427 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.465332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sb67" event={"ID":"9cdbf32e-b191-461f-9320-eeed64359999","Type":"ContainerStarted","Data":"6dea44d6d6d7068d7703d26990f361752819bfbe22dc956d96378c034782f7dd"}
Jul 07 02:15:52.466414 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:52.466390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5s84" event={"ID":"afd45477-45d6-4be0-bd9b-d91917aceb53","Type":"ContainerStarted","Data":"abde063e2ebec20292e792fec45e97b04a16fe6aafc2c6c17dc8c4f940d704a8"}
Jul 07 02:15:53.838986 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:53.838943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:53.839068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.839148    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.839205    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.839220    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.839232    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:16:25.839209209 +0000 UTC m=+99.237207521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:15:53.839462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.839282    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:16:25.839264775 +0000 UTC m=+99.237263099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:15:53.939654 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:53.939616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:15:53.939859 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.939780    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:15:53.939859 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:15:53.939858    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:16:25.93983936 +0000 UTC m=+99.337837684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:15:58.487317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:58.487279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9sb67" event={"ID":"9cdbf32e-b191-461f-9320-eeed64359999","Type":"ContainerStarted","Data":"15d4e0e59a1812ffa16633c5c75c007ce4201e970da03dafcc1e73a5e17846b9"}
Jul 07 02:15:58.488713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:58.488684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5s84" event={"ID":"afd45477-45d6-4be0-bd9b-d91917aceb53","Type":"ContainerStarted","Data":"a24a2db4c72459c4253104a09104029e318328b64f67b00f93dee4b8950ffece"}
Jul 07 02:15:58.488845 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:58.488817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:15:58.506830 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:58.506776    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9sb67" podStartSLOduration=66.080010169 podStartE2EDuration="1m11.506759997s" totalImagesPullingTime="5.426749828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:58.505989269 +0000 UTC m=+71.903987601" watchObservedRunningTime="2026-07-07 02:15:58.506759997 +0000 UTC m=+71.904758328"
Jul 07 02:15:58.521619 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:15:58.521548    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q5s84" podStartSLOduration=66.420565648 podStartE2EDuration="1m11.521531537s" totalImagesPullingTime="5.100965889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:15:58.520925521 +0000 UTC m=+71.918923855" watchObservedRunningTime="2026-07-07 02:15:58.521531537 +0000 UTC m=+71.919529865"
Jul 07 02:16:25.890796 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:16:25.890680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:16:25.890815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.890849    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.890909    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.890920    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.890921    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.890904815 +0000 UTC m=+163.288903126 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:16:25.891225 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.890974    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.890962216 +0000 UTC m=+163.288960525 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:16:25.991785 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:16:25.991751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:16:25.991978 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.991955    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:16:25.992063 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:25.992051    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:17:29.992028049 +0000 UTC m=+163.390026373 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:16:29.493657 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:16:29.493626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q5s84"
Jul 07 02:16:55.914083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:16:55.914046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:16:55.914491 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:55.914156    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:16:55.914491 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:16:55.914213    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:18:57.914198459 +0000 UTC m=+251.312196769 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : secret "metrics-daemon-secret" not found
Jul 07 02:17:24.995484 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:24.995434    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab"
Jul 07 02:17:25.003655 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:25.003595    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" podUID="cacbed8a-b8a3-4d4e-a90f-088073fc07fb"
Jul 07 02:17:25.036405 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:25.036363    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dxmtt" podUID="c1f0f6b2-a049-4b9c-b5e5-56afc465ebef"
Jul 07 02:17:25.160400 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:25.160360    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:17:25.745555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:25.745519    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:17:25.745555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:25.745550    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:17:25.745555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:25.745562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:17:29.985232 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:29.985186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:29.985242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:29.985333    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:29.985339    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:29.985359    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c87548865-p9fxv: secret "image-registry-tls" not found
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:29.985396    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.985381954 +0000 UTC m=+285.383380266 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:17:29.985676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:29.985416    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls podName:fd91cd53-c4fd-4f85-86d5-b784151ebcab nodeName:}" failed. No retries permitted until 2026-07-07 02:19:31.98540282 +0000 UTC m=+285.383401134 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls") pod "image-registry-6c87548865-p9fxv" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab") : secret "image-registry-tls" not found
Jul 07 02:17:30.085683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:30.085648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:17:30.085783 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:30.085757    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 02:17:30.085830 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:17:30.085818    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls podName:c1f0f6b2-a049-4b9c-b5e5-56afc465ebef nodeName:}" failed. No retries permitted until 2026-07-07 02:19:32.08580363 +0000 UTC m=+285.483801940 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls") pod "dns-default-dxmtt" (UID: "c1f0f6b2-a049-4b9c-b5e5-56afc465ebef") : secret "dns-default-metrics-tls" not found
Jul 07 02:17:32.766518 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.766481    2559 generic.go:356] "Generic (PLEG): container finished" podID="49b2f109-f553-41bd-8b54-6f75a30740a2" containerID="daae365f6bdfc706d3e3688df4255504ab679c34380addbaf2150d6587208d2d" exitCode=1
Jul 07 02:17:32.767004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.766559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerDied","Data":"daae365f6bdfc706d3e3688df4255504ab679c34380addbaf2150d6587208d2d"}
Jul 07 02:17:32.767004 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.766943    2559 scope.go:117] "RemoveContainer" containerID="daae365f6bdfc706d3e3688df4255504ab679c34380addbaf2150d6587208d2d"
Jul 07 02:17:32.768065 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.768040    2559 generic.go:356] "Generic (PLEG): container finished" podID="035a8a42-54e7-4a2c-bd9a-a9690ad6915d" containerID="07ae8f7e23b31d923e921d868d8d616625527998aa2d0d10468dc48ac9b285ad" exitCode=255
Jul 07 02:17:32.768155 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.768071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerDied","Data":"07ae8f7e23b31d923e921d868d8d616625527998aa2d0d10468dc48ac9b285ad"}
Jul 07 02:17:32.768360 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:32.768345    2559 scope.go:117] "RemoveContainer" containerID="07ae8f7e23b31d923e921d868d8d616625527998aa2d0d10468dc48ac9b285ad"
Jul 07 02:17:33.398679 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:33.398642    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:17:33.772714 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:33.772674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerStarted","Data":"3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"}
Jul 07 02:17:33.773160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:33.772834    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:17:33.775417 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:33.775396    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:17:33.777048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:33.777027    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerStarted","Data":"e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e"}
Jul 07 02:17:39.149019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:17:39.148938    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:18:57.937198 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:18:57.937141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:18:57.937737 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:18:57.937291    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 02:18:57.937737 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:18:57.937361    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs podName:1254f3fd-6b88-4183-8fd3-6012e6d6c751 nodeName:}" failed. No retries permitted until 2026-07-07 02:20:59.937345292 +0000 UTC m=+373.335343602 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs") pod "network-metrics-daemon-d5z2q" (UID: "1254f3fd-6b88-4183-8fd3-6012e6d6c751") : secret "metrics-daemon-secret" not found
Jul 07 02:19:21.508648 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.508557    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v6lwt"]
Jul 07 02:19:21.510860 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.510787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.514650 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.514626    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 02:19:21.514744 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.514706    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 02:19:21.517412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.517111    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 02:19:21.517412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.517164    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kcspv\""
Jul 07 02:19:21.517412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.517396    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 02:19:21.539133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.539100    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v6lwt"]
Jul 07 02:19:21.615845 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.615807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-crio-socket\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.616020 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.615942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.616020 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.616000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-data-volume\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.616090 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.616021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gj8r\" (UniqueName: \"kubernetes.io/projected/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-api-access-4gj8r\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.616090 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.616063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716786 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-crio-socket\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716883    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-crio-socket\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-data-volume\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gj8r\" (UniqueName: \"kubernetes.io/projected/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-api-access-4gj8r\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.716962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.716979 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:21.716981    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:21.717248 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:21.717036    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.217020744 +0000 UTC m=+275.615019054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:21.717248 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:21.717048    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:21.717248 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:21.717118    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:22.217101134 +0000 UTC m=+275.615099462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:21.717248 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.717178    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-data-volume\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:21.730544 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:21.730520    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gj8r\" (UniqueName: \"kubernetes.io/projected/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-api-access-4gj8r\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:22.221058 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:22.221025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:22.221241 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:22.221074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:22.221241 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:22.221175    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:22.221241 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:22.221181    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:22.221241 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:22.221237    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.221222503 +0000 UTC m=+276.619220815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:22.221400 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:22.221251    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:23.221243944 +0000 UTC m=+276.619242254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:23.229198 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:23.229159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:23.229590 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:23.229217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:23.229590 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:23.229307    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:23.229590 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:23.229343    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:23.229590 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:23.229373    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.229355659 +0000 UTC m=+278.627353993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:23.229590 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:23.229390    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:25.22938255 +0000 UTC m=+278.627380863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:24.501478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:24.501450    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x47k6_898a7b93-f6d5-41ac-9d47-5e1261bca15b/dns-node-resolver/0.log"
Jul 07 02:19:25.107478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:25.107449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68szx_eb3bdc6a-893c-458a-b3b5-88d95070e432/node-ca/0.log"
Jul 07 02:19:25.244500 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:25.244464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:25.244713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:25.244565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:25.244713 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:25.244591    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:25.244713 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:25.244697    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:25.244833 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:25.244756    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.244734136 +0000 UTC m=+282.642732453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:25.244833 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:25.244772    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:29.244765809 +0000 UTC m=+282.642764119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:26.101674 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:26.101644    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfsq5_a53ca3f8-8ba1-424a-a78d-12c0466ddcbd/serve-healthcheck-canary/0.log"
Jul 07 02:19:28.746459 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:28.746413    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab"
Jul 07 02:19:28.746459 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:28.746413    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" podUID="cacbed8a-b8a3-4d4e-a90f-088073fc07fb"
Jul 07 02:19:28.746459 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:28.746423    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dxmtt" podUID="c1f0f6b2-a049-4b9c-b5e5-56afc465ebef"
Jul 07 02:19:29.110892 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:29.110809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:29.111106 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:29.110809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:29.111106 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:29.110816    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:19:29.273391 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:29.273346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:29.273637 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:29.273452    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:29.273637 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:29.273473    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 02:19:29.273637 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:29.273537    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:29.273637 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:29.273552    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.273532489 +0000 UTC m=+290.671530801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : configmap "kube-rbac-proxy" not found
Jul 07 02:19:29.273637 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:29.273598    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls podName:ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4 nodeName:}" failed. No retries permitted until 2026-07-07 02:19:37.273578693 +0000 UTC m=+290.671577006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v6lwt" (UID: "ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4") : secret "insights-runtime-extractor-tls" not found
Jul 07 02:19:31.993366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:31.993324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:31.993839 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:31.993374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:19:31.993839 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:31.993475    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 02:19:31.993839 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:31.993529    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert podName:cacbed8a-b8a3-4d4e-a90f-088073fc07fb nodeName:}" failed. No retries permitted until 2026-07-07 02:21:33.993516361 +0000 UTC m=+407.391514670 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rmjpr" (UID: "cacbed8a-b8a3-4d4e-a90f-088073fc07fb") : secret "networking-console-plugin-cert" not found
Jul 07 02:19:31.995910 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:31.995888    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"image-registry-6c87548865-p9fxv\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") " pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:32.094584 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.094542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:32.097099 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.097070    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1f0f6b2-a049-4b9c-b5e5-56afc465ebef-metrics-tls\") pod \"dns-default-dxmtt\" (UID: \"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef\") " pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:32.116442 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.116405    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nr4jk\""
Jul 07 02:19:32.116442 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.116405    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pv7ql\""
Jul 07 02:19:32.122201 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.122173    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:32.122348 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.122216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:32.263659 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.263637    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxmtt"]
Jul 07 02:19:32.265895 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:19:32.265868    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f0f6b2_a049_4b9c_b5e5_56afc465ebef.slice/crio-a2757aea8329b04ebae6d3e80785d0b9a3eeb64e0ef6668ad094a8bc38190e4a WatchSource:0}: Error finding container a2757aea8329b04ebae6d3e80785d0b9a3eeb64e0ef6668ad094a8bc38190e4a: Status 404 returned error can't find the container with id a2757aea8329b04ebae6d3e80785d0b9a3eeb64e0ef6668ad094a8bc38190e4a
Jul 07 02:19:32.280190 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:32.280164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:19:32.281918 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:19:32.281895    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd91cd53_c4fd_4f85_86d5_b784151ebcab.slice/crio-95c485827d8786fead82692976370842680364faf078517962985f65b79ca63a WatchSource:0}: Error finding container 95c485827d8786fead82692976370842680364faf078517962985f65b79ca63a: Status 404 returned error can't find the container with id 95c485827d8786fead82692976370842680364faf078517962985f65b79ca63a
Jul 07 02:19:33.124731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.124639    2559 generic.go:356] "Generic (PLEG): container finished" podID="035a8a42-54e7-4a2c-bd9a-a9690ad6915d" containerID="e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e" exitCode=255
Jul 07 02:19:33.124731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.124711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerDied","Data":"e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e"}
Jul 07 02:19:33.125238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.124766    2559 scope.go:117] "RemoveContainer" containerID="07ae8f7e23b31d923e921d868d8d616625527998aa2d0d10468dc48ac9b285ad"
Jul 07 02:19:33.125238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.125099    2559 scope.go:117] "RemoveContainer" containerID="e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e"
Jul 07 02:19:33.125348 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:33.125320    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f4869998d-pb9mz_open-cluster-management-agent-addon(035a8a42-54e7-4a2c-bd9a-a9690ad6915d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" podUID="035a8a42-54e7-4a2c-bd9a-a9690ad6915d"
Jul 07 02:19:33.126335 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.126082    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxmtt" event={"ID":"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef","Type":"ContainerStarted","Data":"a2757aea8329b04ebae6d3e80785d0b9a3eeb64e0ef6668ad094a8bc38190e4a"}
Jul 07 02:19:33.127918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.127894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" event={"ID":"fd91cd53-c4fd-4f85-86d5-b784151ebcab","Type":"ContainerStarted","Data":"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"}
Jul 07 02:19:33.128048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.127938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" event={"ID":"fd91cd53-c4fd-4f85-86d5-b784151ebcab","Type":"ContainerStarted","Data":"95c485827d8786fead82692976370842680364faf078517962985f65b79ca63a"}
Jul 07 02:19:33.128048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.127993    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:33.130323 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.130294    2559 generic.go:356] "Generic (PLEG): container finished" podID="49b2f109-f553-41bd-8b54-6f75a30740a2" containerID="3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40" exitCode=1
Jul 07 02:19:33.130419 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.130322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerDied","Data":"3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"}
Jul 07 02:19:33.130680 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.130665    2559 scope.go:117] "RemoveContainer" containerID="3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"
Jul 07 02:19:33.130841 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:33.130824    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-756dd4ddb7-qfz44_open-cluster-management-agent-addon(49b2f109-f553-41bd-8b54-6f75a30740a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" podUID="49b2f109-f553-41bd-8b54-6f75a30740a2"
Jul 07 02:19:33.136398 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.136377    2559 scope.go:117] "RemoveContainer" containerID="daae365f6bdfc706d3e3688df4255504ab679c34380addbaf2150d6587208d2d"
Jul 07 02:19:33.180352 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.180228    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" podStartSLOduration=286.180207261 podStartE2EDuration="4m46.180207261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:33.179754794 +0000 UTC m=+286.577753129" watchObservedRunningTime="2026-07-07 02:19:33.180207261 +0000 UTC m=+286.578205593"
Jul 07 02:19:33.773360 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:33.773328    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:19:34.136176 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:34.136099    2559 scope.go:117] "RemoveContainer" containerID="3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"
Jul 07 02:19:34.136672 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:34.136307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-756dd4ddb7-qfz44_open-cluster-management-agent-addon(49b2f109-f553-41bd-8b54-6f75a30740a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" podUID="49b2f109-f553-41bd-8b54-6f75a30740a2"
Jul 07 02:19:35.142811 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:35.142767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxmtt" event={"ID":"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef","Type":"ContainerStarted","Data":"3b86f77e01135b57b7e9a63af8bda681aee4a883bf4117d97db209e99fd99908"}
Jul 07 02:19:35.143197 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:35.142832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxmtt" event={"ID":"c1f0f6b2-a049-4b9c-b5e5-56afc465ebef","Type":"ContainerStarted","Data":"f5abda4e4837c64800eebd9ae797561fa0de8075f81f479ff881c96bc916ee43"}
Jul 07 02:19:35.143197 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:35.142903    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:35.161028 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:35.160968    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dxmtt" podStartSLOduration=252.18131926 podStartE2EDuration="4m14.160948398s" totalImagesPullingTime="1.979629138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:35.160853659 +0000 UTC m=+288.558851991" watchObservedRunningTime="2026-07-07 02:19:35.160948398 +0000 UTC m=+288.558946731"
Jul 07 02:19:37.342392 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.342345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:37.342792 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.342412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:37.343018 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.342994    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:37.344857 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.344837    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v6lwt\" (UID: \"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4\") " pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:37.420328 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.420281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v6lwt"
Jul 07 02:19:37.554823 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:37.554790    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v6lwt"]
Jul 07 02:19:37.557196 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:19:37.557166    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae92b5c1_b43c_4b19_ba3b_ea84bbe391d4.slice/crio-e7b26f27aac9df007c3fa2e3c094ed2a6f73388307c6f9807ab1a41b9d4b311b WatchSource:0}: Error finding container e7b26f27aac9df007c3fa2e3c094ed2a6f73388307c6f9807ab1a41b9d4b311b: Status 404 returned error can't find the container with id e7b26f27aac9df007c3fa2e3c094ed2a6f73388307c6f9807ab1a41b9d4b311b
Jul 07 02:19:38.155859 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:38.155796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6lwt" event={"ID":"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4","Type":"ContainerStarted","Data":"e7b26f27aac9df007c3fa2e3c094ed2a6f73388307c6f9807ab1a41b9d4b311b"}
Jul 07 02:19:42.149775 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:42.149727    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d5z2q" podUID="1254f3fd-6b88-4183-8fd3-6012e6d6c751"
Jul 07 02:19:42.174922 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.174883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6lwt" event={"ID":"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4","Type":"ContainerStarted","Data":"a47b5c1aace272e96f20bb40f3b32dc0f4e703d284aaee02901a007d716f0157"}
Jul 07 02:19:42.175087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.174971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6lwt" event={"ID":"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4","Type":"ContainerStarted","Data":"64a07f8c1526c1a8574a3dd6d858c138d0026216978ae701e5b265589dbedb1c"}
Jul 07 02:19:42.287424 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.287384    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz"
Jul 07 02:19:42.287762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.287747    2559 scope.go:117] "RemoveContainer" containerID="e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e"
Jul 07 02:19:42.287920 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:42.287903    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5f4869998d-pb9mz_open-cluster-management-agent-addon(035a8a42-54e7-4a2c-bd9a-a9690ad6915d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" podUID="035a8a42-54e7-4a2c-bd9a-a9690ad6915d"
Jul 07 02:19:42.312572 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.312531    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:19:42.312933 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:42.312920    2559 scope.go:117] "RemoveContainer" containerID="3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"
Jul 07 02:19:42.313087 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:19:42.313069    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-756dd4ddb7-qfz44_open-cluster-management-agent-addon(49b2f109-f553-41bd-8b54-6f75a30740a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" podUID="49b2f109-f553-41bd-8b54-6f75a30740a2"
Jul 07 02:19:45.147783 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:45.147750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxmtt"
Jul 07 02:19:45.188789 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:45.188743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v6lwt" event={"ID":"ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4","Type":"ContainerStarted","Data":"4da610e63ecc9eec9999536a791cd64afc216a4a7cc1a62cc071464246dc19bc"}
Jul 07 02:19:45.207623 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:45.207545    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v6lwt" podStartSLOduration=17.238593321 podStartE2EDuration="24.207527159s" totalImagesPullingTime="6.968933838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:19:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:19:45.206442932 +0000 UTC m=+298.604441265" watchObservedRunningTime="2026-07-07 02:19:45.207527159 +0000 UTC m=+298.605525508"
Jul 07 02:19:46.985047 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:46.985020    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 02:19:52.126490 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:52.126455    2559 patch_prober.go:28] interesting pod/image-registry-6c87548865-p9fxv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 02:19:52.128022 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:52.126517    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:19:53.149002 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:53.148958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:19:53.149462 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:53.149216    2559 scope.go:117] "RemoveContainer" containerID="e91e64f48c61071e650adf9fd658ce9e033f540de89b89473b3c87e28e7eb18e"
Jul 07 02:19:53.216304 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:53.216270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f4869998d-pb9mz" event={"ID":"035a8a42-54e7-4a2c-bd9a-a9690ad6915d","Type":"ContainerStarted","Data":"a50a7accc1cfe608d529cdf52caa65e21d366d4b7263637dc95971dab0b1865b"}
Jul 07 02:19:54.142245 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:54.142214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:19:57.149951 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:57.149913    2559 scope.go:117] "RemoveContainer" containerID="3c266e899d9559f6f6c10292ff75c9c2b69d405f7e88d9c160d5762bd5f4ac40"
Jul 07 02:19:57.231996 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:57.231958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" event={"ID":"49b2f109-f553-41bd-8b54-6f75a30740a2","Type":"ContainerStarted","Data":"5f6ea2913706645583edd0e06b7d9482d6a0f578b88f5c948fdd6d8fdd4208d5"}
Jul 07 02:19:57.232268 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:57.232244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:19:57.233299 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:57.233274    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44" podUID="49b2f109-f553-41bd-8b54-6f75a30740a2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Jul 07 02:19:58.236311 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:19:58.236278    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-756dd4ddb7-qfz44"
Jul 07 02:20:05.961705 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:05.961664    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:20:09.142473 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.142439    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fzfgg"]
Jul 07 02:20:09.145190 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.145164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.148362 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.148334    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 02:20:09.148748 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.148723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 02:20:09.149938 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.149906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 02:20:09.150060 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.149915    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9dhbd\""
Jul 07 02:20:09.150060 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.149967    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 02:20:09.150243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.150226    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 02:20:09.150457 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.150436    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 02:20:09.193178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193140    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-tls\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193178 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-sys\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-wtmp\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-textfile\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-root\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-metrics-client-ca\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.193599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.193467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2m6n\" (UniqueName: \"kubernetes.io/projected/cbac583a-6cf3-429f-ab5e-fea69a23c878-kube-api-access-t2m6n\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-textfile\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-root\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294282    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-metrics-client-ca\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2m6n\" (UniqueName: \"kubernetes.io/projected/cbac583a-6cf3-429f-ab5e-fea69a23c878-kube-api-access-t2m6n\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-tls\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294462    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-root\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294545    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-textfile\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-sys\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-wtmp\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.294782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294683    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-sys\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.295037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294807    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-wtmp\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.295037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.294894    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-metrics-client-ca\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.295037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.295031    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-accelerators-collector-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.296923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.296899    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-tls\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.297038 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.296944    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbac583a-6cf3-429f-ab5e-fea69a23c878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.303926 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.303899    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2m6n\" (UniqueName: \"kubernetes.io/projected/cbac583a-6cf3-429f-ab5e-fea69a23c878-kube-api-access-t2m6n\") pod \"node-exporter-fzfgg\" (UID: \"cbac583a-6cf3-429f-ab5e-fea69a23c878\") " pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.456333 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.456241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fzfgg"
Jul 07 02:20:09.465887 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:20:09.465851    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbac583a_6cf3_429f_ab5e_fea69a23c878.slice/crio-108f735421285fecade0280650412bf0e0f142d3d7eb24a929ad5320c119aa33 WatchSource:0}: Error finding container 108f735421285fecade0280650412bf0e0f142d3d7eb24a929ad5320c119aa33: Status 404 returned error can't find the container with id 108f735421285fecade0280650412bf0e0f142d3d7eb24a929ad5320c119aa33
Jul 07 02:20:09.468109 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:09.468086    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:20:10.278149 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:10.278117    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzfgg" event={"ID":"cbac583a-6cf3-429f-ab5e-fea69a23c878","Type":"ContainerStarted","Data":"108f735421285fecade0280650412bf0e0f142d3d7eb24a929ad5320c119aa33"}
Jul 07 02:20:11.283217 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:11.283180    2559 generic.go:356] "Generic (PLEG): container finished" podID="cbac583a-6cf3-429f-ab5e-fea69a23c878" containerID="0848bcb7bd815f816c9c6f8ef342f4a7688e942411a4aaab9a23c49ebf44babf" exitCode=0
Jul 07 02:20:11.283696 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:11.283241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzfgg" event={"ID":"cbac583a-6cf3-429f-ab5e-fea69a23c878","Type":"ContainerDied","Data":"0848bcb7bd815f816c9c6f8ef342f4a7688e942411a4aaab9a23c49ebf44babf"}
Jul 07 02:20:12.288653 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:12.288594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzfgg" event={"ID":"cbac583a-6cf3-429f-ab5e-fea69a23c878","Type":"ContainerStarted","Data":"1c05dd25b4e085a4ec977bc835c0ba9615597eab5a419fae62a2b63ea6306f29"}
Jul 07 02:20:12.289085 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:12.288668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fzfgg" event={"ID":"cbac583a-6cf3-429f-ab5e-fea69a23c878","Type":"ContainerStarted","Data":"29f808b0d075de1ef8025baf8d39cf2a631072073199dfb4e8c3a64980901eef"}
Jul 07 02:20:12.311209 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:12.311156    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fzfgg" podStartSLOduration=2.216494816 podStartE2EDuration="3.311141571s" totalImagesPullingTime="1.022067562s" totalInitContainerRuntime="72.579193ms" isStatefulPod=true podCreationTimestamp="2026-07-07 02:20:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:20:12.309096573 +0000 UTC m=+325.707094906" watchObservedRunningTime="2026-07-07 02:20:12.311141571 +0000 UTC m=+325.709139907"
Jul 07 02:20:30.987884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:30.987839    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerName="registry" containerID="cri-o://61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e" gracePeriod=30
Jul 07 02:20:31.229453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.229427    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:20:31.259590 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259515    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259763 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259592    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259763 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259763 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259682    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259852    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq6p9\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259886    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.259982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.259912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets\") pod \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\" (UID: \"fd91cd53-c4fd-4f85-86d5-b784151ebcab\") "
Jul 07 02:20:31.260183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.260130    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:31.260183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.260161    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:20:31.262632 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.262565    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:31.262953 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.262929    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:31.263052 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.262965    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:31.263188 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.263159    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:20:31.263297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.263191    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9" (OuterVolumeSpecName: "kube-api-access-pq6p9") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "kube-api-access-pq6p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:20:31.269196 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.269164    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fd91cd53-c4fd-4f85-86d5-b784151ebcab" (UID: "fd91cd53-c4fd-4f85-86d5-b784151ebcab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:20:31.349286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.349251    2559 generic.go:356] "Generic (PLEG): container finished" podID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerID="61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e" exitCode=0
Jul 07 02:20:31.349455 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.349302    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87548865-p9fxv"
Jul 07 02:20:31.349455 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.349345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" event={"ID":"fd91cd53-c4fd-4f85-86d5-b784151ebcab","Type":"ContainerDied","Data":"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"}
Jul 07 02:20:31.349455 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.349402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87548865-p9fxv" event={"ID":"fd91cd53-c4fd-4f85-86d5-b784151ebcab","Type":"ContainerDied","Data":"95c485827d8786fead82692976370842680364faf078517962985f65b79ca63a"}
Jul 07 02:20:31.349455 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.349424    2559 scope.go:117] "RemoveContainer" containerID="61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"
Jul 07 02:20:31.357962 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.357945    2559 scope.go:117] "RemoveContainer" containerID="61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"
Jul 07 02:20:31.358264 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:20:31.358240    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e\": container with ID starting with 61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e not found: ID does not exist" containerID="61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"
Jul 07 02:20:31.358333 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.358273    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e"} err="failed to get container status \"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e\": rpc error: code = NotFound desc = could not find container \"61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e\": container with ID starting with 61238ad9bfd02e7aa793f42872bdc81e768f5a608b87e4cb3de5c8a87508004e not found: ID does not exist"
Jul 07 02:20:31.360619 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360583    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd91cd53-c4fd-4f85-86d5-b784151ebcab-ca-trust-extracted\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360622    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-trusted-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360631    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-certificates\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360640    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-registry-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360648    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq6p9\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-kube-api-access-pq6p9\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360655    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd91cd53-c4fd-4f85-86d5-b784151ebcab-bound-sa-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360663    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-installation-pull-secrets\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.360706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.360671    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd91cd53-c4fd-4f85-86d5-b784151ebcab-image-registry-private-configuration\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:20:31.371770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.371745    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:20:31.375111 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:31.375087    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c87548865-p9fxv"]
Jul 07 02:20:32.331749 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:32.331704    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" podUID="1237f1b7-6839-438f-a280-01457f79c1d0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:20:33.152950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:33.152919    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" path="/var/lib/kubelet/pods/fd91cd53-c4fd-4f85-86d5-b784151ebcab/volumes"
Jul 07 02:20:42.332381 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:42.332294    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" podUID="1237f1b7-6839-438f-a280-01457f79c1d0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:20:52.331931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:52.331884    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" podUID="1237f1b7-6839-438f-a280-01457f79c1d0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 02:20:52.332303 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:52.331962    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph"
Jul 07 02:20:52.332518 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:52.332499    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"7bd98648fa375f69b9e5a23e8f16daf17c1ecea0d4195afd4c0a7beb5c8067ed"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 02:20:52.332560 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:52.332543    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" podUID="1237f1b7-6839-438f-a280-01457f79c1d0" containerName="service-proxy" containerID="cri-o://7bd98648fa375f69b9e5a23e8f16daf17c1ecea0d4195afd4c0a7beb5c8067ed" gracePeriod=30
Jul 07 02:20:53.421849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:53.421811    2559 generic.go:356] "Generic (PLEG): container finished" podID="1237f1b7-6839-438f-a280-01457f79c1d0" containerID="7bd98648fa375f69b9e5a23e8f16daf17c1ecea0d4195afd4c0a7beb5c8067ed" exitCode=2
Jul 07 02:20:53.422266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:53.421866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerDied","Data":"7bd98648fa375f69b9e5a23e8f16daf17c1ecea0d4195afd4c0a7beb5c8067ed"}
Jul 07 02:20:53.422266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:53.421911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59c787f568-986ph" event={"ID":"1237f1b7-6839-438f-a280-01457f79c1d0","Type":"ContainerStarted","Data":"2bdadfa5cd7c7b32fd2744985604a518dd8cba43d662b799c1916ba3dc4f2a63"}
Jul 07 02:20:59.974934 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:59.974885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:20:59.977410 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:20:59.977384    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1254f3fd-6b88-4183-8fd3-6012e6d6c751-metrics-certs\") pod \"network-metrics-daemon-d5z2q\" (UID: \"1254f3fd-6b88-4183-8fd3-6012e6d6c751\") " pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:21:00.052663 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:00.052629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92x5k\""
Jul 07 02:21:00.060183 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:00.060156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5z2q"
Jul 07 02:21:00.203598 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:00.203407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5z2q"]
Jul 07 02:21:00.206356 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:21:00.206323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1254f3fd_6b88_4183_8fd3_6012e6d6c751.slice/crio-0d4889a60bf40ae3612e08fcf4841a17d6066a1ca5c7d42e9f8ca9c9ec6e521f WatchSource:0}: Error finding container 0d4889a60bf40ae3612e08fcf4841a17d6066a1ca5c7d42e9f8ca9c9ec6e521f: Status 404 returned error can't find the container with id 0d4889a60bf40ae3612e08fcf4841a17d6066a1ca5c7d42e9f8ca9c9ec6e521f
Jul 07 02:21:00.445550 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:00.445512    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5z2q" event={"ID":"1254f3fd-6b88-4183-8fd3-6012e6d6c751","Type":"ContainerStarted","Data":"0d4889a60bf40ae3612e08fcf4841a17d6066a1ca5c7d42e9f8ca9c9ec6e521f"}
Jul 07 02:21:01.451754 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:01.451706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5z2q" event={"ID":"1254f3fd-6b88-4183-8fd3-6012e6d6c751","Type":"ContainerStarted","Data":"4857d44aed57d1c6a50d0daebf6e481abe6774961333096bea74cb36d1203174"}
Jul 07 02:21:02.457316 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:02.457276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5z2q" event={"ID":"1254f3fd-6b88-4183-8fd3-6012e6d6c751","Type":"ContainerStarted","Data":"5c3d788c9fb8549f8cf4c52cf075bc3f92100e695ae23bcc4b3f9ad7ef2adb1b"}
Jul 07 02:21:02.479149 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:02.479100    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d5z2q" podStartSLOduration=374.367170609 podStartE2EDuration="6m15.479082801s" totalImagesPullingTime="1.111912192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:02.47766474 +0000 UTC m=+375.875663070" watchObservedRunningTime="2026-07-07 02:21:02.479082801 +0000 UTC m=+375.877081133"
Jul 07 02:21:32.111707 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:21:32.111661    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" podUID="cacbed8a-b8a3-4d4e-a90f-088073fc07fb"
Jul 07 02:21:32.557493 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:32.557461    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:21:34.024296 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.024254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:21:34.026888 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.026866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cacbed8a-b8a3-4d4e-a90f-088073fc07fb-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rmjpr\" (UID: \"cacbed8a-b8a3-4d4e-a90f-088073fc07fb\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:21:34.061703 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.061673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sc5fj\""
Jul 07 02:21:34.069155 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.069135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"
Jul 07 02:21:34.200396 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.200227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr"]
Jul 07 02:21:34.203084 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:21:34.203056    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacbed8a_b8a3_4d4e_a90f_088073fc07fb.slice/crio-5dc6b355e62b3aed30fbbe34d8cf90e8db90a8a00e29fee6422b451e8a8bad48 WatchSource:0}: Error finding container 5dc6b355e62b3aed30fbbe34d8cf90e8db90a8a00e29fee6422b451e8a8bad48: Status 404 returned error can't find the container with id 5dc6b355e62b3aed30fbbe34d8cf90e8db90a8a00e29fee6422b451e8a8bad48
Jul 07 02:21:34.565813 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:34.565777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" event={"ID":"cacbed8a-b8a3-4d4e-a90f-088073fc07fb","Type":"ContainerStarted","Data":"5dc6b355e62b3aed30fbbe34d8cf90e8db90a8a00e29fee6422b451e8a8bad48"}
Jul 07 02:21:35.570546 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:35.570438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" event={"ID":"cacbed8a-b8a3-4d4e-a90f-088073fc07fb","Type":"ContainerStarted","Data":"97e855705b2c2cfe6ac58696c2f3826054a87ee3f128839d0e589a73410fdccc"}
Jul 07 02:21:35.586765 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:21:35.586708    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rmjpr" podStartSLOduration=402.469851763 podStartE2EDuration="6m43.58669175s" totalImagesPullingTime="1.116839987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:21:35.586000626 +0000 UTC m=+408.983998959" watchObservedRunningTime="2026-07-07 02:21:35.58669175 +0000 UTC m=+408.984690082"
Jul 07 02:23:05.673272 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.673236    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mkff2"]
Jul 07 02:23:05.673916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.673621    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerName="registry"
Jul 07 02:23:05.673916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.673640    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerName="registry"
Jul 07 02:23:05.673916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.673716    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd91cd53-c4fd-4f85-86d5-b784151ebcab" containerName="registry"
Jul 07 02:23:05.675544 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.675524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.678430 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.678407    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 02:23:05.679883 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.679866    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 02:23:05.679989 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.679937    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7mhv6\""
Jul 07 02:23:05.686446 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.686421    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mkff2"]
Jul 07 02:23:05.755133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.755097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5gx\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-kube-api-access-5p5gx\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.755133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.755136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.856420 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.856378    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5gx\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-kube-api-access-5p5gx\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.856420 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.856420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.865743 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.865701    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.866096 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.866074    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5gx\" (UniqueName: \"kubernetes.io/projected/832d23cb-9a8b-4f65-badb-0dc8d762a3d2-kube-api-access-5p5gx\") pod \"cert-manager-55b4d954d5-mkff2\" (UID: \"832d23cb-9a8b-4f65-badb-0dc8d762a3d2\") " pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:05.984847 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:05.984815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mkff2"
Jul 07 02:23:06.117215 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:06.117182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mkff2"]
Jul 07 02:23:06.120938 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:23:06.120910    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod832d23cb_9a8b_4f65_badb_0dc8d762a3d2.slice/crio-389bd6c38a0a6b91f4367b8a5febdf1195ad5959adc8ae1bf0b4297baad72b15 WatchSource:0}: Error finding container 389bd6c38a0a6b91f4367b8a5febdf1195ad5959adc8ae1bf0b4297baad72b15: Status 404 returned error can't find the container with id 389bd6c38a0a6b91f4367b8a5febdf1195ad5959adc8ae1bf0b4297baad72b15
Jul 07 02:23:06.879673 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:06.879589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mkff2" event={"ID":"832d23cb-9a8b-4f65-badb-0dc8d762a3d2","Type":"ContainerStarted","Data":"389bd6c38a0a6b91f4367b8a5febdf1195ad5959adc8ae1bf0b4297baad72b15"}
Jul 07 02:23:07.279678 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.279643    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"]
Jul 07 02:23:07.282198 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.282168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.285340 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.285132    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 02:23:07.285340 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.285321    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 02:23:07.286760 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.286735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wmbdn\""
Jul 07 02:23:07.292965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.292769    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"]
Jul 07 02:23:07.367894 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.367856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9rqj\" (UniqueName: \"kubernetes.io/projected/925d3fe3-f356-4b60-af5e-a691c66ed091-kube-api-access-d9rqj\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.368105 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.367909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925d3fe3-f356-4b60-af5e-a691c66ed091-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.468499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.468454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9rqj\" (UniqueName: \"kubernetes.io/projected/925d3fe3-f356-4b60-af5e-a691c66ed091-kube-api-access-d9rqj\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.468713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.468543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925d3fe3-f356-4b60-af5e-a691c66ed091-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.469013 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.468979    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925d3fe3-f356-4b60-af5e-a691c66ed091-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.478741 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.478706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9rqj\" (UniqueName: \"kubernetes.io/projected/925d3fe3-f356-4b60-af5e-a691c66ed091-kube-api-access-d9rqj\") pod \"openshift-lws-operator-fd8ccff4c-5vcbx\" (UID: \"925d3fe3-f356-4b60-af5e-a691c66ed091\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:07.596940 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:07.596852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"
Jul 07 02:23:09.361271 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:09.361245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx"]
Jul 07 02:23:09.364553 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:23:09.364517    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod925d3fe3_f356_4b60_af5e_a691c66ed091.slice/crio-d1c011e5615c8526cc6fb6683a1ee561236854ab7586fa2dcb0e93fd2e8ba9c9 WatchSource:0}: Error finding container d1c011e5615c8526cc6fb6683a1ee561236854ab7586fa2dcb0e93fd2e8ba9c9: Status 404 returned error can't find the container with id d1c011e5615c8526cc6fb6683a1ee561236854ab7586fa2dcb0e93fd2e8ba9c9
Jul 07 02:23:09.895006 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:09.894966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx" event={"ID":"925d3fe3-f356-4b60-af5e-a691c66ed091","Type":"ContainerStarted","Data":"d1c011e5615c8526cc6fb6683a1ee561236854ab7586fa2dcb0e93fd2e8ba9c9"}
Jul 07 02:23:09.897022 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:09.896986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mkff2" event={"ID":"832d23cb-9a8b-4f65-badb-0dc8d762a3d2","Type":"ContainerStarted","Data":"a36379401786ea67a0b7aaea4b747308cd9ba605eeaef97abbb015bb43b346eb"}
Jul 07 02:23:09.915766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:09.915703    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mkff2" podStartSLOduration=1.769614052 podStartE2EDuration="4.915679214s" totalImagesPullingTime="3.146065162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:09.915114468 +0000 UTC m=+503.313112800" watchObservedRunningTime="2026-07-07 02:23:09.915679214 +0000 UTC m=+503.313677550"
Jul 07 02:23:11.906656 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:11.906546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx" event={"ID":"925d3fe3-f356-4b60-af5e-a691c66ed091","Type":"ContainerStarted","Data":"fa70b8cd41ac764ad89baca54f8e840a62ab7b8afd0c69724d7d1bfd13b5a579"}
Jul 07 02:23:11.924919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:11.924860    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5vcbx" podStartSLOduration=2.648121335 podStartE2EDuration="4.924836721s" totalImagesPullingTime="2.276715386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:11.923679453 +0000 UTC m=+505.321677784" watchObservedRunningTime="2026-07-07 02:23:11.924836721 +0000 UTC m=+505.322835054"
Jul 07 02:23:31.297141 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.297101    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"]
Jul 07 02:23:31.299648 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.299625    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.305541 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.305519    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 02:23:31.305699 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.305669    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 02:23:31.306039 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.305811    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 02:23:31.306120 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.306096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sj57n\""
Jul 07 02:23:31.306297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.306280    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 02:23:31.316521 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.316493    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"]
Jul 07 02:23:31.344717 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.344681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ndg\" (UniqueName: \"kubernetes.io/projected/f99fdbc0-8829-4cf5-9d79-20b976ec0252-kube-api-access-q6ndg\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.344904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.344730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.344904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.344796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.344904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.344824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.344904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.344848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445239    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ndg\" (UniqueName: \"kubernetes.io/projected/f99fdbc0-8829-4cf5-9d79-20b976ec0252-kube-api-access-q6ndg\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.445740 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.445718    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-manifests\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.447700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.447668    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f99fdbc0-8829-4cf5-9d79-20b976ec0252-tmp\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.447885 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.447862    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-apiservice-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.447942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.447927    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f99fdbc0-8829-4cf5-9d79-20b976ec0252-webhook-cert\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.455163 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.455140    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ndg\" (UniqueName: \"kubernetes.io/projected/f99fdbc0-8829-4cf5-9d79-20b976ec0252-kube-api-access-q6ndg\") pod \"opendatahub-operator-controller-manager-778f769c96-r44fw\" (UID: \"f99fdbc0-8829-4cf5-9d79-20b976ec0252\") " pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.610302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.610216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:31.744034 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.743999    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"]
Jul 07 02:23:31.746526 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:23:31.746495    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99fdbc0_8829_4cf5_9d79_20b976ec0252.slice/crio-8bbe9abdfce27f0f8103ff52d30852651b5c572841c6b742ac0f047f1539ea0e WatchSource:0}: Error finding container 8bbe9abdfce27f0f8103ff52d30852651b5c572841c6b742ac0f047f1539ea0e: Status 404 returned error can't find the container with id 8bbe9abdfce27f0f8103ff52d30852651b5c572841c6b742ac0f047f1539ea0e
Jul 07 02:23:31.976221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:31.976129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw" event={"ID":"f99fdbc0-8829-4cf5-9d79-20b976ec0252","Type":"ContainerStarted","Data":"8bbe9abdfce27f0f8103ff52d30852651b5c572841c6b742ac0f047f1539ea0e"}
Jul 07 02:23:34.990182 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:34.990144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw" event={"ID":"f99fdbc0-8829-4cf5-9d79-20b976ec0252","Type":"ContainerStarted","Data":"1781cc44e0de6e1c8b39ff02d993ff664e547939c9feaeb3a625fc7123cebd41"}
Jul 07 02:23:35.994954 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:35.994855    2559 generic.go:356] "Generic (PLEG): container finished" podID="f99fdbc0-8829-4cf5-9d79-20b976ec0252" containerID="1781cc44e0de6e1c8b39ff02d993ff664e547939c9feaeb3a625fc7123cebd41" exitCode=0
Jul 07 02:23:35.994954 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:35.994919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw" event={"ID":"f99fdbc0-8829-4cf5-9d79-20b976ec0252","Type":"ContainerDied","Data":"1781cc44e0de6e1c8b39ff02d993ff664e547939c9feaeb3a625fc7123cebd41"}
Jul 07 02:23:37.000062 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:37.000030    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw" event={"ID":"f99fdbc0-8829-4cf5-9d79-20b976ec0252","Type":"ContainerStarted","Data":"0794e244f7f1c447ad7f84fbd49350187de02f07f5e7a31da761f61a2b8f8603"}
Jul 07 02:23:37.000461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:37.000161    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:37.024317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:37.024261    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw" podStartSLOduration=1.710336866 podStartE2EDuration="6.02424331s" totalImagesPullingTime="3.302415207s" totalInitContainerRuntime="1.011491237s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:23:37.021989657 +0000 UTC m=+530.419987990" watchObservedRunningTime="2026-07-07 02:23:37.02424331 +0000 UTC m=+530.422241641"
Jul 07 02:23:48.005770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:48.005739    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-778f769c96-r44fw"
Jul 07 02:23:57.142445 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.142394    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:23:57.151902 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.151870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.155078 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.155041    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 02:23:57.155078 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.155061    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 02:23:57.155299 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.155081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xnnhq\""
Jul 07 02:23:57.155299 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.155045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 02:23:57.155456 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.155439    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 02:23:57.156330 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.156308    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 02:23:57.156439 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.156308    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 02:23:57.160110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.159935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:23:57.209512 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209512 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gls\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.209775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.209703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gls\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.310888 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.310858    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.312849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.312814    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.312849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.312833    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.313007 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.312852    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.313007 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.312915    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.319547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.319523    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.320202 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.320166    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gls\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls\") pod \"istiod-openshift-gateway-7574459656-8jtmm\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.462246 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.462163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:23:57.622513 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:57.622486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:23:57.624469 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:23:57.624444    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fede92f_a4ab_494f_a2db_eae07e3ab447.slice/crio-bfe2484549429504f576407aa355a69c02baa20ee94e172f3b0cb7bab981664a WatchSource:0}: Error finding container bfe2484549429504f576407aa355a69c02baa20ee94e172f3b0cb7bab981664a: Status 404 returned error can't find the container with id bfe2484549429504f576407aa355a69c02baa20ee94e172f3b0cb7bab981664a
Jul 07 02:23:58.094952 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:23:58.094910    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" event={"ID":"0fede92f-a4ab-494f-a2db-eae07e3ab447","Type":"ContainerStarted","Data":"bfe2484549429504f576407aa355a69c02baa20ee94e172f3b0cb7bab981664a"}
Jul 07 02:24:00.228363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.228325    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"]
Jul 07 02:24:00.230506 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.230484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.250436 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.250391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"]
Jul 07 02:24:00.329726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5bb\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-kube-api-access-pq5bb\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.329904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.329904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329807    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.329904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.329904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.330089 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.330089 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.329996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430378 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5bb\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-kube-api-access-pq5bb\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430479    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.430869 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.430571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.431410 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.431376    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.433590 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.433548    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.433725 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.433643    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.433972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.433951    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.434420 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.434399    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.442193 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.442113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.442344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.442273    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5bb\" (UniqueName: \"kubernetes.io/projected/f36a3c00-2c1c-47aa-be48-0e3f2f7fc673-kube-api-access-pq5bb\") pod \"istiod-openshift-gateway-94bb8fbfd-pzclc\" (UID: \"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:00.540780 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:00.540742    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:01.097527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:01.097477    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:24:01.097713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:01.097559    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:24:01.219627 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:01.219577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"]
Jul 07 02:24:01.222184 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:24:01.222154    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36a3c00_2c1c_47aa_be48_0e3f2f7fc673.slice/crio-aa45617d4c4e031b8a68f911083c38c182c7cc71c7b852ab3f1be043e9604c6c WatchSource:0}: Error finding container aa45617d4c4e031b8a68f911083c38c182c7cc71c7b852ab3f1be043e9604c6c: Status 404 returned error can't find the container with id aa45617d4c4e031b8a68f911083c38c182c7cc71c7b852ab3f1be043e9604c6c
Jul 07 02:24:01.226135 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:01.226102    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:24:01.226218 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:01.226166    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:24:02.119902 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.119864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" event={"ID":"0fede92f-a4ab-494f-a2db-eae07e3ab447","Type":"ContainerStarted","Data":"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"}
Jul 07 02:24:02.120390 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.120032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:24:02.121940 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.121908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc" event={"ID":"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673","Type":"ContainerStarted","Data":"db07a4cafaa75ec0898777745b0c258e5ea65b341ca669c2df2b2ca050879d9f"}
Jul 07 02:24:02.122075 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.121953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc" event={"ID":"f36a3c00-2c1c-47aa-be48-0e3f2f7fc673","Type":"ContainerStarted","Data":"aa45617d4c4e031b8a68f911083c38c182c7cc71c7b852ab3f1be043e9604c6c"}
Jul 07 02:24:02.122145 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.122082    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8jtmm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:24:02.122145 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.122125    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:02.122252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.122132    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:24:02.123509 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.123483    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-pzclc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:24:02.123647 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.123536    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc" podUID="f36a3c00-2c1c-47aa-be48-0e3f2f7fc673" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:24:02.188026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.187969    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" podStartSLOduration=1.7172388189999999 podStartE2EDuration="5.187951689s" totalImagesPullingTime="3.47071287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:02.186108289 +0000 UTC m=+555.584106613" watchObservedRunningTime="2026-07-07 02:24:02.187951689 +0000 UTC m=+555.585950021"
Jul 07 02:24:02.248035 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:02.247982    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc" podStartSLOduration=2.247963544 podStartE2EDuration="2.247963544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:02.246528071 +0000 UTC m=+555.644526405" watchObservedRunningTime="2026-07-07 02:24:02.247963544 +0000 UTC m=+555.645961875"
Jul 07 02:24:03.126849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:03.126814    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8jtmm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:24:03.127298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:03.126870    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:24:03.127298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:03.126821    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-pzclc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:24:03.127298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:03.126964    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc" podUID="f36a3c00-2c1c-47aa-be48-0e3f2f7fc673" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:24:06.127684 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.127651    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:24:06.128388 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.127757    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pzclc"
Jul 07 02:24:06.220669 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.220633    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:24:06.220904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.220862    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery" containerID="cri-o://eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee" gracePeriod=30
Jul 07 02:24:06.505396 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.505356    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:24:06.586781 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586752    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7gls\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586896    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.586963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.586911    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs\") pod \"0fede92f-a4ab-494f-a2db-eae07e3ab447\" (UID: \"0fede92f-a4ab-494f-a2db-eae07e3ab447\") "
Jul 07 02:24:06.589021 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.588964    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:24:06.589365 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.589343    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts" (OuterVolumeSpecName: "cacerts") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:24:06.589564 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.589537    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls" (OuterVolumeSpecName: "kube-api-access-p7gls") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "kube-api-access-p7gls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:24:06.589694 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.589669    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:24:06.590560 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.590541    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:24:06.590765 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.590742    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs" (OuterVolumeSpecName: "local-certs") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:24:06.591046 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.591032    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0fede92f-a4ab-494f-a2db-eae07e3ab447" (UID: "0fede92f-a4ab-494f-a2db-eae07e3ab447"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687600    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-kubeconfig\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687657    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-ca-configmap\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687668    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-csr-dns-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687679    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7gls\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-kube-api-access-p7gls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687687    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fede92f-a4ab-494f-a2db-eae07e3ab447-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687695    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fede92f-a4ab-494f-a2db-eae07e3ab447-local-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:06.687708 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:06.687702    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0fede92f-a4ab-494f-a2db-eae07e3ab447-cacerts\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:07.143096 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.143057    2559 generic.go:356] "Generic (PLEG): container finished" podID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerID="eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee" exitCode=0
Jul 07 02:24:07.143096 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.143099    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"
Jul 07 02:24:07.143587 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.143102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" event={"ID":"0fede92f-a4ab-494f-a2db-eae07e3ab447","Type":"ContainerDied","Data":"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"}
Jul 07 02:24:07.143587 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.143151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm" event={"ID":"0fede92f-a4ab-494f-a2db-eae07e3ab447","Type":"ContainerDied","Data":"bfe2484549429504f576407aa355a69c02baa20ee94e172f3b0cb7bab981664a"}
Jul 07 02:24:07.143587 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.143178    2559 scope.go:117] "RemoveContainer" containerID="eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"
Jul 07 02:24:07.152769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.152747    2559 scope.go:117] "RemoveContainer" containerID="eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"
Jul 07 02:24:07.153014 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:24:07.152993    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee\": container with ID starting with eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee not found: ID does not exist" containerID="eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"
Jul 07 02:24:07.153084 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.153028    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee"} err="failed to get container status \"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee\": rpc error: code = NotFound desc = could not find container \"eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee\": container with ID starting with eeb5c916e0362d4a04f581e3dd126007ee658feca59d6dbdaac50850315e5fee not found: ID does not exist"
Jul 07 02:24:07.171822 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.171787    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:24:07.176297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:07.176269    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8jtmm"]
Jul 07 02:24:09.153263 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:09.153226    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" path="/var/lib/kubelet/pods/0fede92f-a4ab-494f-a2db-eae07e3ab447/volumes"
Jul 07 02:24:51.543967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.543936    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:51.544365 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.544200    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery"
Jul 07 02:24:51.544365 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.544211    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery"
Jul 07 02:24:51.544365 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.544270    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fede92f-a4ab-494f-a2db-eae07e3ab447" containerName="discovery"
Jul 07 02:24:51.546889 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.546868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:51.551412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.551383    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 02:24:51.551555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.551443    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 02:24:51.551555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.551383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gwxss\""
Jul 07 02:24:51.559757 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.559731    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:51.626161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.626125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khv9n\" (UniqueName: \"kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n\") pod \"kuadrant-operator-catalog-pbvcb\" (UID: \"49ef7208-375d-42a2-b706-cc76262d66dd\") " pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:51.727517 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.727470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khv9n\" (UniqueName: \"kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n\") pod \"kuadrant-operator-catalog-pbvcb\" (UID: \"49ef7208-375d-42a2-b706-cc76262d66dd\") " pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:51.741883 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.741845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khv9n\" (UniqueName: \"kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n\") pod \"kuadrant-operator-catalog-pbvcb\" (UID: \"49ef7208-375d-42a2-b706-cc76262d66dd\") " pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:51.856903 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.856793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:51.916270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.916237    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:51.991085 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:51.991058    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:51.993375 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:24:51.993350    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ef7208_375d_42a2_b706_cc76262d66dd.slice/crio-42e32ab4aa883466a3959a50f550c203a3d37aab24bebab5f60bbeb968545fb8 WatchSource:0}: Error finding container 42e32ab4aa883466a3959a50f550c203a3d37aab24bebab5f60bbeb968545fb8: Status 404 returned error can't find the container with id 42e32ab4aa883466a3959a50f550c203a3d37aab24bebab5f60bbeb968545fb8
Jul 07 02:24:52.126467 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.126380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppgjc"]
Jul 07 02:24:52.129468 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.129368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:24:52.137827 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.137800    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppgjc"]
Jul 07 02:24:52.232162 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.232122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gt6\" (UniqueName: \"kubernetes.io/projected/5568fad6-744a-4771-9bf5-4df49c21bfc3-kube-api-access-x7gt6\") pod \"kuadrant-operator-catalog-ppgjc\" (UID: \"5568fad6-744a-4771-9bf5-4df49c21bfc3\") " pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:24:52.322422 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.322390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" event={"ID":"49ef7208-375d-42a2-b706-cc76262d66dd","Type":"ContainerStarted","Data":"42e32ab4aa883466a3959a50f550c203a3d37aab24bebab5f60bbeb968545fb8"}
Jul 07 02:24:52.333919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.333883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gt6\" (UniqueName: \"kubernetes.io/projected/5568fad6-744a-4771-9bf5-4df49c21bfc3-kube-api-access-x7gt6\") pod \"kuadrant-operator-catalog-ppgjc\" (UID: \"5568fad6-744a-4771-9bf5-4df49c21bfc3\") " pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:24:52.343015 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.342980    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gt6\" (UniqueName: \"kubernetes.io/projected/5568fad6-744a-4771-9bf5-4df49c21bfc3-kube-api-access-x7gt6\") pod \"kuadrant-operator-catalog-ppgjc\" (UID: \"5568fad6-744a-4771-9bf5-4df49c21bfc3\") " pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:24:52.439819 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.439716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:24:52.573421 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:52.573393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppgjc"]
Jul 07 02:24:52.575697 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:24:52.575659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5568fad6_744a_4771_9bf5_4df49c21bfc3.slice/crio-6d8a888b9154cfe6d20b310e05a6a0bdcdc2b70cfefdbbe68e0bda3ab95861c2 WatchSource:0}: Error finding container 6d8a888b9154cfe6d20b310e05a6a0bdcdc2b70cfefdbbe68e0bda3ab95861c2: Status 404 returned error can't find the container with id 6d8a888b9154cfe6d20b310e05a6a0bdcdc2b70cfefdbbe68e0bda3ab95861c2
Jul 07 02:24:53.330412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:53.330367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc" event={"ID":"5568fad6-744a-4771-9bf5-4df49c21bfc3","Type":"ContainerStarted","Data":"6d8a888b9154cfe6d20b310e05a6a0bdcdc2b70cfefdbbe68e0bda3ab95861c2"}
Jul 07 02:24:54.336325 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.336292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc" event={"ID":"5568fad6-744a-4771-9bf5-4df49c21bfc3","Type":"ContainerStarted","Data":"fbf88f622939d872af592083a80b3f257499cd68a28158388874597705fd0de9"}
Jul 07 02:24:54.338035 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.338008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" event={"ID":"49ef7208-375d-42a2-b706-cc76262d66dd","Type":"ContainerStarted","Data":"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"}
Jul 07 02:24:54.338169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.338113    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" podUID="49ef7208-375d-42a2-b706-cc76262d66dd" containerName="registry-server" containerID="cri-o://87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d" gracePeriod=2
Jul 07 02:24:54.355729 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.355661    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc" podStartSLOduration=0.713823181 podStartE2EDuration="2.355637268s" totalImagesPullingTime="1.641814087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:54.354140416 +0000 UTC m=+607.752138751" watchObservedRunningTime="2026-07-07 02:24:54.355637268 +0000 UTC m=+607.753635604"
Jul 07 02:24:54.372362 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.372294    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" podStartSLOduration=1.150984178 podStartE2EDuration="3.372269513s" totalImagesPullingTime="2.221285335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:24:54.371152688 +0000 UTC m=+607.769151021" watchObservedRunningTime="2026-07-07 02:24:54.372269513 +0000 UTC m=+607.770267847"
Jul 07 02:24:54.585729 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.585703    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:54.754594 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.754558    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khv9n\" (UniqueName: \"kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n\") pod \"49ef7208-375d-42a2-b706-cc76262d66dd\" (UID: \"49ef7208-375d-42a2-b706-cc76262d66dd\") "
Jul 07 02:24:54.756973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.756948    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n" (OuterVolumeSpecName: "kube-api-access-khv9n") pod "49ef7208-375d-42a2-b706-cc76262d66dd" (UID: "49ef7208-375d-42a2-b706-cc76262d66dd"). InnerVolumeSpecName "kube-api-access-khv9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:24:54.855471 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:54.855380    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khv9n\" (UniqueName: \"kubernetes.io/projected/49ef7208-375d-42a2-b706-cc76262d66dd-kube-api-access-khv9n\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:24:55.342954 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.342918    2559 generic.go:356] "Generic (PLEG): container finished" podID="49ef7208-375d-42a2-b706-cc76262d66dd" containerID="87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d" exitCode=0
Jul 07 02:24:55.343406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.342956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" event={"ID":"49ef7208-375d-42a2-b706-cc76262d66dd","Type":"ContainerDied","Data":"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"}
Jul 07 02:24:55.343406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.343005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb" event={"ID":"49ef7208-375d-42a2-b706-cc76262d66dd","Type":"ContainerDied","Data":"42e32ab4aa883466a3959a50f550c203a3d37aab24bebab5f60bbeb968545fb8"}
Jul 07 02:24:55.343406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.343029    2559 scope.go:117] "RemoveContainer" containerID="87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"
Jul 07 02:24:55.343406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.342964    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pbvcb"
Jul 07 02:24:55.351786 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.351763    2559 scope.go:117] "RemoveContainer" containerID="87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"
Jul 07 02:24:55.352057 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:24:55.352040    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d\": container with ID starting with 87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d not found: ID does not exist" containerID="87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"
Jul 07 02:24:55.352130 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.352066    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d"} err="failed to get container status \"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d\": rpc error: code = NotFound desc = could not find container \"87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d\": container with ID starting with 87738cc4e424e8d8c42a1172b3e89f4b61ae857f23157f283902257e0cbb270d not found: ID does not exist"
Jul 07 02:24:55.361164 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.361136    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:55.365225 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:55.365202    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pbvcb"]
Jul 07 02:24:57.153121 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:24:57.153091    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ef7208-375d-42a2-b706-cc76262d66dd" path="/var/lib/kubelet/pods/49ef7208-375d-42a2-b706-cc76262d66dd/volumes"
Jul 07 02:25:02.439973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:02.439932    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:25:02.440490 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:02.440004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:25:02.463131 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:02.463098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:25:03.396450 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:03.396425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ppgjc"
Jul 07 02:25:31.169478 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.169441    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"]
Jul 07 02:25:31.169956 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.169751    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ef7208-375d-42a2-b706-cc76262d66dd" containerName="registry-server"
Jul 07 02:25:31.169956 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.169765    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ef7208-375d-42a2-b706-cc76262d66dd" containerName="registry-server"
Jul 07 02:25:31.169956 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.169828    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ef7208-375d-42a2-b706-cc76262d66dd" containerName="registry-server"
Jul 07 02:25:31.176049 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.176026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:31.179516 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.179491    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 02:25:31.179645 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.179541    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z6pvq\""
Jul 07 02:25:31.184750 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.184723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"]
Jul 07 02:25:31.213119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.213081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lcqj\" (UniqueName: \"kubernetes.io/projected/381cc729-b948-43f3-a229-18c21ff7f951-kube-api-access-8lcqj\") pod \"dns-operator-controller-manager-864dd78c4c-h28c6\" (UID: \"381cc729-b948-43f3-a229-18c21ff7f951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:31.314083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.314043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lcqj\" (UniqueName: \"kubernetes.io/projected/381cc729-b948-43f3-a229-18c21ff7f951-kube-api-access-8lcqj\") pod \"dns-operator-controller-manager-864dd78c4c-h28c6\" (UID: \"381cc729-b948-43f3-a229-18c21ff7f951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:31.335283 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.335251    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lcqj\" (UniqueName: \"kubernetes.io/projected/381cc729-b948-43f3-a229-18c21ff7f951-kube-api-access-8lcqj\") pod \"dns-operator-controller-manager-864dd78c4c-h28c6\" (UID: \"381cc729-b948-43f3-a229-18c21ff7f951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:31.486458 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.486425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:31.623202 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.623173    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"]
Jul 07 02:25:31.625590 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:25:31.625562    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381cc729_b948_43f3_a229_18c21ff7f951.slice/crio-fc52501b2e227105a17adc4c56b74c97d5112312b4d76e1fb40bb66ed6fc7060 WatchSource:0}: Error finding container fc52501b2e227105a17adc4c56b74c97d5112312b4d76e1fb40bb66ed6fc7060: Status 404 returned error can't find the container with id fc52501b2e227105a17adc4c56b74c97d5112312b4d76e1fb40bb66ed6fc7060
Jul 07 02:25:31.627669 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:31.627653    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:25:32.492102 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:32.492062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6" event={"ID":"381cc729-b948-43f3-a229-18c21ff7f951","Type":"ContainerStarted","Data":"fc52501b2e227105a17adc4c56b74c97d5112312b4d76e1fb40bb66ed6fc7060"}
Jul 07 02:25:34.503154 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:34.503120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6" event={"ID":"381cc729-b948-43f3-a229-18c21ff7f951","Type":"ContainerStarted","Data":"565564a0b877be9667c46f56b6b97c9e7665fb441f04e75fbfcb25c476bbe9fa"}
Jul 07 02:25:34.503555 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:34.503349    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:34.523899 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:34.523846    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6" podStartSLOduration=1.374670483 podStartE2EDuration="3.523828676s" totalImagesPullingTime="2.149158193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:34.522654461 +0000 UTC m=+647.920652793" watchObservedRunningTime="2026-07-07 02:25:34.523828676 +0000 UTC m=+647.921827007"
Jul 07 02:25:35.220839 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.220804    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"]
Jul 07 02:25:35.224043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.224023    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:35.227188 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.227167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jdjgn\""
Jul 07 02:25:35.244964 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.244925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8str\" (UniqueName: \"kubernetes.io/projected/96af44e2-9bb9-4aff-acdf-6f8ca45a8f18-kube-api-access-m8str\") pod \"authorino-operator-75cc8d5cb7-5qrpl\" (UID: \"96af44e2-9bb9-4aff-acdf-6f8ca45a8f18\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:35.245155 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.245134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"]
Jul 07 02:25:35.345815 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.345772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8str\" (UniqueName: \"kubernetes.io/projected/96af44e2-9bb9-4aff-acdf-6f8ca45a8f18-kube-api-access-m8str\") pod \"authorino-operator-75cc8d5cb7-5qrpl\" (UID: \"96af44e2-9bb9-4aff-acdf-6f8ca45a8f18\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:35.355681 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.355649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8str\" (UniqueName: \"kubernetes.io/projected/96af44e2-9bb9-4aff-acdf-6f8ca45a8f18-kube-api-access-m8str\") pod \"authorino-operator-75cc8d5cb7-5qrpl\" (UID: \"96af44e2-9bb9-4aff-acdf-6f8ca45a8f18\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:35.536085 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.536049    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:35.664929 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:35.664898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"]
Jul 07 02:25:35.667725 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:25:35.667700    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96af44e2_9bb9_4aff_acdf_6f8ca45a8f18.slice/crio-afd29dd3215d050f498289d4d437ad15a274a53e2cad914668dcade7246e7f1d WatchSource:0}: Error finding container afd29dd3215d050f498289d4d437ad15a274a53e2cad914668dcade7246e7f1d: Status 404 returned error can't find the container with id afd29dd3215d050f498289d4d437ad15a274a53e2cad914668dcade7246e7f1d
Jul 07 02:25:36.514172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:36.514129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl" event={"ID":"96af44e2-9bb9-4aff-acdf-6f8ca45a8f18","Type":"ContainerStarted","Data":"afd29dd3215d050f498289d4d437ad15a274a53e2cad914668dcade7246e7f1d"}
Jul 07 02:25:38.523825 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:38.523784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl" event={"ID":"96af44e2-9bb9-4aff-acdf-6f8ca45a8f18","Type":"ContainerStarted","Data":"2da6cb56136322ee594fdd05f8e04bc69570f190a50087e78246b1a0fbf6337a"}
Jul 07 02:25:38.524231 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:38.523899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:38.544797 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:38.544745    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl" podStartSLOduration=1.309833631 podStartE2EDuration="3.544728593s" totalImagesPullingTime="2.234894962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:38.54340974 +0000 UTC m=+651.941408072" watchObservedRunningTime="2026-07-07 02:25:38.544728593 +0000 UTC m=+651.942726924"
Jul 07 02:25:40.179210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.179174    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"]
Jul 07 02:25:40.182292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.182274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.188939 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.188904    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9l8b\""
Jul 07 02:25:40.212077 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.212046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"]
Jul 07 02:25:40.283842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.283798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ddf\" (UniqueName: \"kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.284034 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.283858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.385140 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.385090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ddf\" (UniqueName: \"kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.385327 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.385158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.385501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.385485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.402779 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.402754    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ddf\" (UniqueName: \"kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.492199 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.492159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:40.628762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:40.628741    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"]
Jul 07 02:25:40.631571 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:25:40.631546    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d143280_9c21_4bea_bc42_1fd067501d7a.slice/crio-47174815fd27148e58b0a836947424ea2f3f7a95cdf786d7b6f8a03db6ea8a09 WatchSource:0}: Error finding container 47174815fd27148e58b0a836947424ea2f3f7a95cdf786d7b6f8a03db6ea8a09: Status 404 returned error can't find the container with id 47174815fd27148e58b0a836947424ea2f3f7a95cdf786d7b6f8a03db6ea8a09
Jul 07 02:25:41.540052 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:41.540011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw" event={"ID":"1d143280-9c21-4bea-bc42-1fd067501d7a","Type":"ContainerStarted","Data":"47174815fd27148e58b0a836947424ea2f3f7a95cdf786d7b6f8a03db6ea8a09"}
Jul 07 02:25:43.463098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.463066    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"]
Jul 07 02:25:43.466233 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.466217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:43.469296 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.469267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gtj5r\""
Jul 07 02:25:43.485571 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.485534    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"]
Jul 07 02:25:43.511009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.510961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64sn\" (UniqueName: \"kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn\") pod \"limitador-operator-controller-manager-859d7b78bd-64vdd\" (UID: \"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:43.612202 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.612166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64sn\" (UniqueName: \"kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn\") pod \"limitador-operator-controller-manager-859d7b78bd-64vdd\" (UID: \"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:43.622404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.622360    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64sn\" (UniqueName: \"kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn\") pod \"limitador-operator-controller-manager-859d7b78bd-64vdd\" (UID: \"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:43.777206 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.777168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:43.923501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:43.923469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"]
Jul 07 02:25:43.927589 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:25:43.927563    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2347b8_41ba_4817_92f5_5d9bd4f28bfc.slice/crio-9ed70c9ec1a713e93ad9512988814845cb8a3eb0bd1750b686b05910ce34dd82 WatchSource:0}: Error finding container 9ed70c9ec1a713e93ad9512988814845cb8a3eb0bd1750b686b05910ce34dd82: Status 404 returned error can't find the container with id 9ed70c9ec1a713e93ad9512988814845cb8a3eb0bd1750b686b05910ce34dd82
Jul 07 02:25:44.556779 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:44.556740    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd" event={"ID":"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc","Type":"ContainerStarted","Data":"9ed70c9ec1a713e93ad9512988814845cb8a3eb0bd1750b686b05910ce34dd82"}
Jul 07 02:25:45.509526 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:45.509489    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-h28c6"
Jul 07 02:25:47.573450 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.573411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd" event={"ID":"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc","Type":"ContainerStarted","Data":"4faa4b326f9baa4b469d8a0d24100e787f68e64abce94c450afe810d2ff2a54f"}
Jul 07 02:25:47.573931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.573534    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:47.575241 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.575212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw" event={"ID":"1d143280-9c21-4bea-bc42-1fd067501d7a","Type":"ContainerStarted","Data":"b2043937e8080354e42fa8bfa0c5f6bec0cb0d3fdbeca24b112971bc24c363f6"}
Jul 07 02:25:47.575393 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.575339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:47.593363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.593299    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd" podStartSLOduration=1.552968042 podStartE2EDuration="4.593275333s" totalImagesPullingTime="3.040307291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:47.591019756 +0000 UTC m=+660.989018078" watchObservedRunningTime="2026-07-07 02:25:47.593275333 +0000 UTC m=+660.991273670"
Jul 07 02:25:47.610516 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:47.610458    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw" podStartSLOduration=1.2673957009999999 podStartE2EDuration="7.610439094s" totalImagesPullingTime="6.343043393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:25:47.609955349 +0000 UTC m=+661.007953682" watchObservedRunningTime="2026-07-07 02:25:47.610439094 +0000 UTC m=+661.008437426"
Jul 07 02:25:49.530539 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:49.530508    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5qrpl"
Jul 07 02:25:58.582212 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:58.582182    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:25:58.582656 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:58.582251    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:25:59.819155 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.819110    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"]
Jul 07 02:25:59.822810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.822792    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:25:59.847273 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.847234    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"]
Jul 07 02:25:59.956878 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.956842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:25:59.957071 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.956913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjt9n\" (UniqueName: \"kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:25:59.983159 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:25:59.983125    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"]
Jul 07 02:25:59.983379 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:25:59.983358    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-wjt9n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928"
Jul 07 02:26:00.056857 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.056821    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"]
Jul 07 02:26:00.057621 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.057583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.057685 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.057652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjt9n\" (UniqueName: \"kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.058047 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.058026    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.059907 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.059887    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.083021 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.082951    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"]
Jul 07 02:26:00.085355 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.085321    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjt9n\" (UniqueName: \"kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.158841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.158795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.159028 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.158854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhzc\" (UniqueName: \"kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.259275 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.259237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.259275 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.259280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhzc\" (UniqueName: \"kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.259646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.259597    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.273032 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.273007    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhzc\" (UniqueName: \"kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc\") pod \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.369437 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.369345    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.433815 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.433716    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"]
Jul 07 02:26:00.435147 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.435029    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"]
Jul 07 02:26:00.452174 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.452005    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"]
Jul 07 02:26:00.454673 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.454593    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"]
Jul 07 02:26:00.458801 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.457256    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:00.463180 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.463153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.467699 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.467676    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"]
Jul 07 02:26:00.467890 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.467861    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" containerName="manager" containerID="cri-o://b2043937e8080354e42fa8bfa0c5f6bec0cb0d3fdbeca24b112971bc24c363f6" gracePeriod=2
Jul 07 02:26:00.479433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.479403    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:00.488682 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.488649    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"]
Jul 07 02:26:00.501778 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.501736    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:00.502404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.502190    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" containerName="manager"
Jul 07 02:26:00.502404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.502214    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" containerName="manager"
Jul 07 02:26:00.502404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.502300    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" containerName="manager"
Jul 07 02:26:00.505724 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.505697    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"]
Jul 07 02:26:00.505866 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.505797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.505932 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.505899    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" containerName="manager" containerID="cri-o://4faa4b326f9baa4b469d8a0d24100e787f68e64abce94c450afe810d2ff2a54f" gracePeriod=2
Jul 07 02:26:00.508713 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.508554    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.512991 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.512596    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.515912 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.514861    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"]
Jul 07 02:26:00.516378 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.516164    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.517991 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.517970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:00.532976 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.532945    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"]
Jul 07 02:26:00.533354 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.533337    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" containerName="manager"
Jul 07 02:26:00.533434 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.533358    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" containerName="manager"
Jul 07 02:26:00.533499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.533439    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" containerName="manager"
Jul 07 02:26:00.536750 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.536730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:00.548767 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.548534    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.550184 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.550116    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"]
Jul 07 02:26:00.551444 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.551341    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.561584 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.561551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.561756 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.561638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdkf\" (UniqueName: \"kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.634069 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.634013    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d143280-9c21-4bea-bc42-1fd067501d7a" containerID="b2043937e8080354e42fa8bfa0c5f6bec0cb0d3fdbeca24b112971bc24c363f6" exitCode=0
Jul 07 02:26:00.636203 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.636173    2559 generic.go:356] "Generic (PLEG): container finished" podID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" containerID="4faa4b326f9baa4b469d8a0d24100e787f68e64abce94c450afe810d2ff2a54f" exitCode=0
Jul 07 02:26:00.636308 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.636252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.639418 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.639344    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.642031 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.641917    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.644449 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.644422    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.644724 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.644702    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.647462 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.647431    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.649754 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.649723    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.652122 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.652098    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.662347 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.662453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2q84\" (UniqueName: \"kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.662453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.662453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdkf\" (UniqueName: \"kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.662564 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlswp\" (UniqueName: \"kubernetes.io/projected/e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a-kube-api-access-vlswp\") pod \"limitador-operator-controller-manager-859d7b78bd-gk5hj\" (UID: \"e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:00.662720 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.662700    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.671658 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.671627    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdkf\" (UniqueName: \"kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf\") pod \"kuadrant-operator-controller-manager-55467d9f7-f66vn\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.687013 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.686980    2559 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 07 02:26:00.687013 ip-10-0-142-72 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-22vqv_kuadrant-system_ea817665-a1c8-47c9-9b70-410e8f48c743_0(1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-22vqv to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588" Netns:"/var/run/netns/29874fd9-25fb-454a-93b2-b5889c99aa84" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-22vqv;K8S_POD_INFRA_CONTAINER_ID=1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588;K8S_POD_UID=ea817665-a1c8-47c9-9b70-410e8f48c743" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv/ea817665-a1c8-47c9-9b70-410e8f48c743:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv 1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv 1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:1a [10.132.0.26/23]
Jul 07 02:26:00.687013 ip-10-0-142-72 kubenswrapper[2559]:         '
Jul 07 02:26:00.687013 ip-10-0-142-72 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 07 02:26:00.687013 ip-10-0-142-72 kubenswrapper[2559]:  >
Jul 07 02:26:00.687193 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.687041    2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 07 02:26:00.687193 ip-10-0-142-72 kubenswrapper[2559]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-22vqv_kuadrant-system_ea817665-a1c8-47c9-9b70-410e8f48c743_0(1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-22vqv to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588" Netns:"/var/run/netns/29874fd9-25fb-454a-93b2-b5889c99aa84" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-22vqv;K8S_POD_INFRA_CONTAINER_ID=1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588;K8S_POD_UID=ea817665-a1c8-47c9-9b70-410e8f48c743" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv/ea817665-a1c8-47c9-9b70-410e8f48c743:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv 1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv 1a2c787aa14ca8b8dad350e119d3054a933566a7edd495eefc8f893bdc7dd588 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:84:00:1a [10.132.0.26/23]
Jul 07 02:26:00.687193 ip-10-0-142-72 kubenswrapper[2559]:         '
Jul 07 02:26:00.687193 ip-10-0-142-72 kubenswrapper[2559]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 07 02:26:00.687193 ip-10-0-142-72 kubenswrapper[2559]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:00.743359 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.743333    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.746144 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.746115    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.748738 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.748701    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.750181 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.750161    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.754309 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.754285    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.756769 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.756745    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7f2gw\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:00.759425 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.759404    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-64vdd\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:00.761894 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:00.761873    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:00.763076 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjt9n\" (UniqueName: \"kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n\") pod \"2c7de11f-36e8-43ec-b148-67e5bb532928\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") "
Jul 07 02:26:00.763210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763194    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume\") pod \"2c7de11f-36e8-43ec-b148-67e5bb532928\" (UID: \"2c7de11f-36e8-43ec-b148-67e5bb532928\") "
Jul 07 02:26:00.763374 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.763451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2q84\" (UniqueName: \"kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.763451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763436    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c7de11f-36e8-43ec-b148-67e5bb532928" (UID: "2c7de11f-36e8-43ec-b148-67e5bb532928"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:26:00.763548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlswp\" (UniqueName: \"kubernetes.io/projected/e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a-kube-api-access-vlswp\") pod \"limitador-operator-controller-manager-859d7b78bd-gk5hj\" (UID: \"e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:00.763597 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763558    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c7de11f-36e8-43ec-b148-67e5bb532928-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:00.763805 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.763783    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.765358 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.765340    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n" (OuterVolumeSpecName: "kube-api-access-wjt9n") pod "2c7de11f-36e8-43ec-b148-67e5bb532928" (UID: "2c7de11f-36e8-43ec-b148-67e5bb532928"). InnerVolumeSpecName "kube-api-access-wjt9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:00.778450 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.778428    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:00.778790 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.778771    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2q84\" (UniqueName: \"kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lqg4h\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.782297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.782273    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlswp\" (UniqueName: \"kubernetes.io/projected/e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a-kube-api-access-vlswp\") pod \"limitador-operator-controller-manager-859d7b78bd-gk5hj\" (UID: \"e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:00.864207 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.864173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume\") pod \"1d143280-9c21-4bea-bc42-1fd067501d7a\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") "
Jul 07 02:26:00.864665 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.864227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n64sn\" (UniqueName: \"kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn\") pod \"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc\" (UID: \"cb2347b8-41ba-4817-92f5-5d9bd4f28bfc\") "
Jul 07 02:26:00.864665 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.864289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52ddf\" (UniqueName: \"kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf\") pod \"1d143280-9c21-4bea-bc42-1fd067501d7a\" (UID: \"1d143280-9c21-4bea-bc42-1fd067501d7a\") "
Jul 07 02:26:00.864665 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.864493    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjt9n\" (UniqueName: \"kubernetes.io/projected/2c7de11f-36e8-43ec-b148-67e5bb532928-kube-api-access-wjt9n\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:00.864840 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.864799    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d143280-9c21-4bea-bc42-1fd067501d7a" (UID: "1d143280-9c21-4bea-bc42-1fd067501d7a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:26:00.866967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.866937    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf" (OuterVolumeSpecName: "kube-api-access-52ddf") pod "1d143280-9c21-4bea-bc42-1fd067501d7a" (UID: "1d143280-9c21-4bea-bc42-1fd067501d7a"). InnerVolumeSpecName "kube-api-access-52ddf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:00.868777 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.868752    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn" (OuterVolumeSpecName: "kube-api-access-n64sn") pod "cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" (UID: "cb2347b8-41ba-4817-92f5-5d9bd4f28bfc"). InnerVolumeSpecName "kube-api-access-n64sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:00.881996 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.881906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:00.889285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.889237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:00.924311 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.924227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:00.927715 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:00.927682    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400e2d90_0bd3_4af4_be31_f11dec9361ed.slice/crio-183df17ac4f694b2a812446fe34d78d5820a5aec3f831c52470b5732bcce4eb4 WatchSource:0}: Error finding container 183df17ac4f694b2a812446fe34d78d5820a5aec3f831c52470b5732bcce4eb4: Status 404 returned error can't find the container with id 183df17ac4f694b2a812446fe34d78d5820a5aec3f831c52470b5732bcce4eb4
Jul 07 02:26:00.965732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.965699    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52ddf\" (UniqueName: \"kubernetes.io/projected/1d143280-9c21-4bea-bc42-1fd067501d7a-kube-api-access-52ddf\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:00.965732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.965733    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d143280-9c21-4bea-bc42-1fd067501d7a-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:00.965966 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:00.965749    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n64sn\" (UniqueName: \"kubernetes.io/projected/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc-kube-api-access-n64sn\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:01.048479 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.048451    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:01.050814 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:01.050784    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b5dd0b_a598_4891_aac7_9ba659b20270.slice/crio-22fe9835b815deaabca8718cd53f6b12377403014fc4358e83dac8773dcbd51c WatchSource:0}: Error finding container 22fe9835b815deaabca8718cd53f6b12377403014fc4358e83dac8773dcbd51c: Status 404 returned error can't find the container with id 22fe9835b815deaabca8718cd53f6b12377403014fc4358e83dac8773dcbd51c
Jul 07 02:26:01.061020 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.060993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"]
Jul 07 02:26:01.064510 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:01.064468    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d99e95_5cc9_4ef1_b556_43c0f87e7d2a.slice/crio-c18edf592989c0091077fb8a5b30cc0299733b2266fd78bbd7fffb50c2564645 WatchSource:0}: Error finding container c18edf592989c0091077fb8a5b30cc0299733b2266fd78bbd7fffb50c2564645: Status 404 returned error can't find the container with id c18edf592989c0091077fb8a5b30cc0299733b2266fd78bbd7fffb50c2564645
Jul 07 02:26:01.157458 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.157426    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d143280-9c21-4bea-bc42-1fd067501d7a" path="/var/lib/kubelet/pods/1d143280-9c21-4bea-bc42-1fd067501d7a/volumes"
Jul 07 02:26:01.157841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.157818    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" path="/var/lib/kubelet/pods/2c7de11f-36e8-43ec-b148-67e5bb532928/volumes"
Jul 07 02:26:01.158043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.158030    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2347b8-41ba-4817-92f5-5d9bd4f28bfc" path="/var/lib/kubelet/pods/cb2347b8-41ba-4817-92f5-5d9bd4f28bfc/volumes"
Jul 07 02:26:01.643207 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.643180    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-64vdd"
Jul 07 02:26:01.643383 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.643184    2559 scope.go:117] "RemoveContainer" containerID="4faa4b326f9baa4b469d8a0d24100e787f68e64abce94c450afe810d2ff2a54f"
Jul 07 02:26:01.644938 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.644908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj" event={"ID":"e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a","Type":"ContainerStarted","Data":"661597a996d44d7e8e4e5ee24ec67eaac9ceac1f662cdf73e249512ee646ba3f"}
Jul 07 02:26:01.645031 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.644966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj" event={"ID":"e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a","Type":"ContainerStarted","Data":"c18edf592989c0091077fb8a5b30cc0299733b2266fd78bbd7fffb50c2564645"}
Jul 07 02:26:01.645031 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.645019    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:01.646575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.646550    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7f2gw"
Jul 07 02:26:01.648327 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.648290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" event={"ID":"82b5dd0b-a598-4891-aac7-9ba659b20270","Type":"ContainerStarted","Data":"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"}
Jul 07 02:26:01.648440 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.648330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" event={"ID":"82b5dd0b-a598-4891-aac7-9ba659b20270","Type":"ContainerStarted","Data":"22fe9835b815deaabca8718cd53f6b12377403014fc4358e83dac8773dcbd51c"}
Jul 07 02:26:01.648440 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.648353    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:01.650019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.649993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" event={"ID":"400e2d90-0bd3-4af4-be31-f11dec9361ed","Type":"ContainerStarted","Data":"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"}
Jul 07 02:26:01.650137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.650034    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" event={"ID":"400e2d90-0bd3-4af4-be31-f11dec9361ed","Type":"ContainerStarted","Data":"183df17ac4f694b2a812446fe34d78d5820a5aec3f831c52470b5732bcce4eb4"}
Jul 07 02:26:01.650137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.650080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:01.650137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.650124    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:01.653262 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.653237    2559 scope.go:117] "RemoveContainer" containerID="b2043937e8080354e42fa8bfa0c5f6bec0cb0d3fdbeca24b112971bc24c363f6"
Jul 07 02:26:01.659291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.659268    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:01.666306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.666259    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj" podStartSLOduration=1.666244941 podStartE2EDuration="1.666244941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:01.665290153 +0000 UTC m=+675.063288487" watchObservedRunningTime="2026-07-07 02:26:01.666244941 +0000 UTC m=+675.064243273"
Jul 07 02:26:01.688384 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.688329    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" podStartSLOduration=1.688313953 podStartE2EDuration="1.688313953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:01.68711722 +0000 UTC m=+675.085115551" watchObservedRunningTime="2026-07-07 02:26:01.688313953 +0000 UTC m=+675.086312350"
Jul 07 02:26:01.711861 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.711805    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" podStartSLOduration=1.711787234 podStartE2EDuration="1.711787234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:01.709518448 +0000 UTC m=+675.107516780" watchObservedRunningTime="2026-07-07 02:26:01.711787234 +0000 UTC m=+675.109785565"
Jul 07 02:26:01.712560 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:01.712534    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:01.715277 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:01.715258    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="ea817665-a1c8-47c9-9b70-410e8f48c743" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:01.772631 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.772575    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dhzc\" (UniqueName: \"kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc\") pod \"ea817665-a1c8-47c9-9b70-410e8f48c743\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") "
Jul 07 02:26:01.772829 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.772663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume\") pod \"ea817665-a1c8-47c9-9b70-410e8f48c743\" (UID: \"ea817665-a1c8-47c9-9b70-410e8f48c743\") "
Jul 07 02:26:01.772957 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.772933    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ea817665-a1c8-47c9-9b70-410e8f48c743" (UID: "ea817665-a1c8-47c9-9b70-410e8f48c743"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:26:01.774968 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.774945    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc" (OuterVolumeSpecName: "kube-api-access-5dhzc") pod "ea817665-a1c8-47c9-9b70-410e8f48c743" (UID: "ea817665-a1c8-47c9-9b70-410e8f48c743"). InnerVolumeSpecName "kube-api-access-5dhzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:01.873554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.873510    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dhzc\" (UniqueName: \"kubernetes.io/projected/ea817665-a1c8-47c9-9b70-410e8f48c743-kube-api-access-5dhzc\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:01.873554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:01.873548    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea817665-a1c8-47c9-9b70-410e8f48c743-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:02.657595 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:02.657558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:02.657896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:02.657799    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:02.660914 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:02.660885    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="ea817665-a1c8-47c9-9b70-410e8f48c743" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:02.663445 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:02.663421    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:02.665764 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:02.665743    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sjmg4\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="2c7de11f-36e8-43ec-b148-67e5bb532928" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sjmg4"
Jul 07 02:26:02.668135 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:02.668115    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-22vqv\" is forbidden: User \"system:node:ip-10-0-142-72.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-72.ec2.internal' and this object" podUID="ea817665-a1c8-47c9-9b70-410e8f48c743" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-22vqv"
Jul 07 02:26:03.158943 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:03.158910    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea817665-a1c8-47c9-9b70-410e8f48c743" path="/var/lib/kubelet/pods/ea817665-a1c8-47c9-9b70-410e8f48c743/volumes"
Jul 07 02:26:12.659534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:12.659502    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gk5hj"
Jul 07 02:26:12.660059 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:12.659589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:13.663924 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.663890    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:13.719032 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.719003    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:13.719204 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.719172    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" podUID="82b5dd0b-a598-4891-aac7-9ba659b20270" containerName="manager" containerID="cri-o://1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685" gracePeriod=10
Jul 07 02:26:13.973276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.973246    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:13.976053 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.976027    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:26:13.976310 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.976297    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b5dd0b-a598-4891-aac7-9ba659b20270" containerName="manager"
Jul 07 02:26:13.976310 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.976310    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b5dd0b-a598-4891-aac7-9ba659b20270" containerName="manager"
Jul 07 02:26:13.976383 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.976361    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b5dd0b-a598-4891-aac7-9ba659b20270" containerName="manager"
Jul 07 02:26:13.978759 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:13.978744    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.004710 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.004679    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:26:14.071967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.071934    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume\") pod \"82b5dd0b-a598-4891-aac7-9ba659b20270\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") "
Jul 07 02:26:14.072143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.072009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2q84\" (UniqueName: \"kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84\") pod \"82b5dd0b-a598-4891-aac7-9ba659b20270\" (UID: \"82b5dd0b-a598-4891-aac7-9ba659b20270\") "
Jul 07 02:26:14.072143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.072115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.072236 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.072177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6khz\" (UniqueName: \"kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.072354 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.072328    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "82b5dd0b-a598-4891-aac7-9ba659b20270" (UID: "82b5dd0b-a598-4891-aac7-9ba659b20270"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:26:14.074237 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.074206    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84" (OuterVolumeSpecName: "kube-api-access-b2q84") pod "82b5dd0b-a598-4891-aac7-9ba659b20270" (UID: "82b5dd0b-a598-4891-aac7-9ba659b20270"). InnerVolumeSpecName "kube-api-access-b2q84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:14.173516 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.173473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6khz\" (UniqueName: \"kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.173762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.173552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.173762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.173601    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2q84\" (UniqueName: \"kubernetes.io/projected/82b5dd0b-a598-4891-aac7-9ba659b20270-kube-api-access-b2q84\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:14.173762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.173643    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82b5dd0b-a598-4891-aac7-9ba659b20270-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:14.174046 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.174019    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.183432 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.183403    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6khz\" (UniqueName: \"kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz\") pod \"kuadrant-operator-controller-manager-86878c769f-cvlwq\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.287599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.287561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.418381 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.418348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:26:14.420987 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:14.420964    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d52df29_53e7_43a4_a35e_a907f6165d59.slice/crio-f10824bb20a43126a9f2fe5c4bbc2173c5be0e11f2863f8b5eb38cd9528c24e7 WatchSource:0}: Error finding container f10824bb20a43126a9f2fe5c4bbc2173c5be0e11f2863f8b5eb38cd9528c24e7: Status 404 returned error can't find the container with id f10824bb20a43126a9f2fe5c4bbc2173c5be0e11f2863f8b5eb38cd9528c24e7
Jul 07 02:26:14.718734 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.718632    2559 generic.go:356] "Generic (PLEG): container finished" podID="82b5dd0b-a598-4891-aac7-9ba659b20270" containerID="1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685" exitCode=0
Jul 07 02:26:14.718734 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.718681    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"
Jul 07 02:26:14.718734 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.718720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" event={"ID":"82b5dd0b-a598-4891-aac7-9ba659b20270","Type":"ContainerDied","Data":"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"}
Jul 07 02:26:14.719258 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.718779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h" event={"ID":"82b5dd0b-a598-4891-aac7-9ba659b20270","Type":"ContainerDied","Data":"22fe9835b815deaabca8718cd53f6b12377403014fc4358e83dac8773dcbd51c"}
Jul 07 02:26:14.719258 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.718812    2559 scope.go:117] "RemoveContainer" containerID="1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"
Jul 07 02:26:14.720494 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.720470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" event={"ID":"1d52df29-53e7-43a4-a35e-a907f6165d59","Type":"ContainerStarted","Data":"03831eb6dc3c1f343f13118df98112ada7a5674261330395c6e793af0885dbec"}
Jul 07 02:26:14.720601 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.720518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" event={"ID":"1d52df29-53e7-43a4-a35e-a907f6165d59","Type":"ContainerStarted","Data":"f10824bb20a43126a9f2fe5c4bbc2173c5be0e11f2863f8b5eb38cd9528c24e7"}
Jul 07 02:26:14.720601 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.720546    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:14.727542 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.727527    2559 scope.go:117] "RemoveContainer" containerID="1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"
Jul 07 02:26:14.727819 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:14.727803    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685\": container with ID starting with 1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685 not found: ID does not exist" containerID="1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"
Jul 07 02:26:14.727871 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.727828    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685"} err="failed to get container status \"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685\": rpc error: code = NotFound desc = could not find container \"1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685\": container with ID starting with 1f9b88e13edec87aa7f1c903461d2e62c149d5c2b17cc2e7a3e3aca5b1499685 not found: ID does not exist"
Jul 07 02:26:14.745911 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.745821    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" podStartSLOduration=1.745805922 podStartE2EDuration="1.745805922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:14.745242411 +0000 UTC m=+688.143240743" watchObservedRunningTime="2026-07-07 02:26:14.745805922 +0000 UTC m=+688.143804255"
Jul 07 02:26:14.759747 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.759714    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:14.763716 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:14.763689    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lqg4h"]
Jul 07 02:26:15.154019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:15.153984    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b5dd0b-a598-4891-aac7-9ba659b20270" path="/var/lib/kubelet/pods/82b5dd0b-a598-4891-aac7-9ba659b20270/volumes"
Jul 07 02:26:25.729031 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:25.729000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:26:25.807499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:25.807461    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:25.807755 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:25.807714    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" podUID="400e2d90-0bd3-4af4-be31-f11dec9361ed" containerName="manager" containerID="cri-o://8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce" gracePeriod=10
Jul 07 02:26:26.057823 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.057797    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:26.172983 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.172874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fdkf\" (UniqueName: \"kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf\") pod \"400e2d90-0bd3-4af4-be31-f11dec9361ed\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") "
Jul 07 02:26:26.172983 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.172930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume\") pod \"400e2d90-0bd3-4af4-be31-f11dec9361ed\" (UID: \"400e2d90-0bd3-4af4-be31-f11dec9361ed\") "
Jul 07 02:26:26.173386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.173359    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "400e2d90-0bd3-4af4-be31-f11dec9361ed" (UID: "400e2d90-0bd3-4af4-be31-f11dec9361ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:26:26.175124 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.175102    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf" (OuterVolumeSpecName: "kube-api-access-6fdkf") pod "400e2d90-0bd3-4af4-be31-f11dec9361ed" (UID: "400e2d90-0bd3-4af4-be31-f11dec9361ed"). InnerVolumeSpecName "kube-api-access-6fdkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:26:26.274203 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.274159    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fdkf\" (UniqueName: \"kubernetes.io/projected/400e2d90-0bd3-4af4-be31-f11dec9361ed-kube-api-access-6fdkf\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:26.274203 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.274194    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/400e2d90-0bd3-4af4-be31-f11dec9361ed-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:26:26.776955 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.776914    2559 generic.go:356] "Generic (PLEG): container finished" podID="400e2d90-0bd3-4af4-be31-f11dec9361ed" containerID="8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce" exitCode=0
Jul 07 02:26:26.777495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.776960    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"
Jul 07 02:26:26.777495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.776981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" event={"ID":"400e2d90-0bd3-4af4-be31-f11dec9361ed","Type":"ContainerDied","Data":"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"}
Jul 07 02:26:26.777495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.777026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn" event={"ID":"400e2d90-0bd3-4af4-be31-f11dec9361ed","Type":"ContainerDied","Data":"183df17ac4f694b2a812446fe34d78d5820a5aec3f831c52470b5732bcce4eb4"}
Jul 07 02:26:26.777495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.777045    2559 scope.go:117] "RemoveContainer" containerID="8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"
Jul 07 02:26:26.785562 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.785542    2559 scope.go:117] "RemoveContainer" containerID="8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"
Jul 07 02:26:26.785880 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:26:26.785860    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce\": container with ID starting with 8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce not found: ID does not exist" containerID="8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"
Jul 07 02:26:26.785937 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.785892    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce"} err="failed to get container status \"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce\": rpc error: code = NotFound desc = could not find container \"8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce\": container with ID starting with 8ec5f6c2530fa0c56178a59485352370524a412d95f138f3a04a801b04d6c7ce not found: ID does not exist"
Jul 07 02:26:26.798695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.798660    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:26.802855 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:26.802826    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-f66vn"]
Jul 07 02:26:27.153663 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:27.153579    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="400e2d90-0bd3-4af4-be31-f11dec9361ed" path="/var/lib/kubelet/pods/400e2d90-0bd3-4af4-be31-f11dec9361ed/volumes"
Jul 07 02:26:30.074110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.074077    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"]
Jul 07 02:26:30.074489 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.074402    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="400e2d90-0bd3-4af4-be31-f11dec9361ed" containerName="manager"
Jul 07 02:26:30.074489 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.074414    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="400e2d90-0bd3-4af4-be31-f11dec9361ed" containerName="manager"
Jul 07 02:26:30.074489 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.074484    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="400e2d90-0bd3-4af4-be31-f11dec9361ed" containerName="manager"
Jul 07 02:26:30.077399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.077376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.080485 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.080463    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8h44d\""
Jul 07 02:26:30.089814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.089782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"]
Jul 07 02:26:30.106305 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljdz9\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-kube-api-access-ljdz9\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.106593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.106562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207585 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207585 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207665    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljdz9\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-kube-api-access-ljdz9\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.207873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.207838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.208224 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.208096    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.208346 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.208253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.208440 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.208418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.208546 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.208525    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.208584 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.208532    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.210911 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.210883    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.211039 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.211021    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.217247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.217218    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.217446 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.217416    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljdz9\" (UniqueName: \"kubernetes.io/projected/b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb-kube-api-access-ljdz9\") pod \"maas-default-gateway-openshift-default-56654dcf7-6pmgx\" (UID: \"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.387554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.387460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:30.521732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.521701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"]
Jul 07 02:26:30.524018 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:30.523989    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bbac12_4cd6_45a1_b591_6cbc9d6cfeeb.slice/crio-2ef26db2df0e9af63ee5f30cdba3af2b1d10c137b2b894b44ceed6c0967c61ba WatchSource:0}: Error finding container 2ef26db2df0e9af63ee5f30cdba3af2b1d10c137b2b894b44ceed6c0967c61ba: Status 404 returned error can't find the container with id 2ef26db2df0e9af63ee5f30cdba3af2b1d10c137b2b894b44ceed6c0967c61ba
Jul 07 02:26:30.796306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:30.796270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" event={"ID":"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb","Type":"ContainerStarted","Data":"2ef26db2df0e9af63ee5f30cdba3af2b1d10c137b2b894b44ceed6c0967c61ba"}
Jul 07 02:26:33.346716 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:33.346676    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:26:33.346967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:33.346754    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:26:33.346967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:33.346787    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:26:33.813476 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:33.813429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" event={"ID":"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb","Type":"ContainerStarted","Data":"db425a0b6d654f86fb69b53c16638a2d67fa9ec7049d68e8be6f40f7629ff452"}
Jul 07 02:26:33.835883 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:33.835818    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" podStartSLOduration=1.015918986 podStartE2EDuration="3.835803384s" totalImagesPullingTime="2.819884398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:33.835322452 +0000 UTC m=+707.233320797" watchObservedRunningTime="2026-07-07 02:26:33.835803384 +0000 UTC m=+707.233801715"
Jul 07 02:26:34.388653 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:34.388585    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:34.394151 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:34.394127    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:34.818189 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:34.818157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:34.819096 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:34.819076    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:26:44.918014 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:44.917936    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:26:44.921082 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:44.921062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:44.924098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:44.924072    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 02:26:44.924352 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:44.924333    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7mtwz\""
Jul 07 02:26:44.930009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:44.929982    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:26:45.019702 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.019668    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:26:45.022250 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.022221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.022391 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.022259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csq4k\" (UniqueName: \"kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.123650 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.123585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.123840 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.123704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csq4k\" (UniqueName: \"kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.124454 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.124425    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.132803 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.132776    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csq4k\" (UniqueName: \"kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k\") pod \"limitador-limitador-64c94fd64f-wfxws\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.232295 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.232259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:45.372224 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.372160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:26:45.374684 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:26:45.374654    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42535ec3_1a6e_467b_b6b4_fb7245c1a272.slice/crio-fdc8e3e8b45cd4f61f4bae1ed28d78cacefdc975f37088cec3b1d09cf0b2cd3e WatchSource:0}: Error finding container fdc8e3e8b45cd4f61f4bae1ed28d78cacefdc975f37088cec3b1d09cf0b2cd3e: Status 404 returned error can't find the container with id fdc8e3e8b45cd4f61f4bae1ed28d78cacefdc975f37088cec3b1d09cf0b2cd3e
Jul 07 02:26:45.864571 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:45.864537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" event={"ID":"42535ec3-1a6e-467b-b6b4-fb7245c1a272","Type":"ContainerStarted","Data":"fdc8e3e8b45cd4f61f4bae1ed28d78cacefdc975f37088cec3b1d09cf0b2cd3e"}
Jul 07 02:26:48.879864 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:48.879828    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" event={"ID":"42535ec3-1a6e-467b-b6b4-fb7245c1a272","Type":"ContainerStarted","Data":"8b8d8b7bb3abad9c9a749d44408f7d51c47ab1c16e97b0bdbeeca9ee56cc988f"}
Jul 07 02:26:48.880304 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:48.880013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:26:48.897545 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:48.897493    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" podStartSLOduration=2.096426576 podStartE2EDuration="4.897477027s" totalImagesPullingTime="2.801050451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:26:48.895781503 +0000 UTC m=+722.293779851" watchObservedRunningTime="2026-07-07 02:26:48.897477027 +0000 UTC m=+722.295475396"
Jul 07 02:26:59.885214 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:26:59.885177    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:27:02.121106 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:02.121067    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:27:02.121672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:02.121265    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" podUID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" containerName="limitador" containerID="cri-o://8b8d8b7bb3abad9c9a749d44408f7d51c47ab1c16e97b0bdbeeca9ee56cc988f" gracePeriod=30
Jul 07 02:27:02.947963 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:02.947929    2559 generic.go:356] "Generic (PLEG): container finished" podID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" containerID="8b8d8b7bb3abad9c9a749d44408f7d51c47ab1c16e97b0bdbeeca9ee56cc988f" exitCode=0
Jul 07 02:27:02.948094 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:02.948001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" event={"ID":"42535ec3-1a6e-467b-b6b4-fb7245c1a272","Type":"ContainerDied","Data":"8b8d8b7bb3abad9c9a749d44408f7d51c47ab1c16e97b0bdbeeca9ee56cc988f"}
Jul 07 02:27:03.079381 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.079353    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:27:03.180064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.180024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csq4k\" (UniqueName: \"kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k\") pod \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") "
Jul 07 02:27:03.180444 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.180079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file\") pod \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\" (UID: \"42535ec3-1a6e-467b-b6b4-fb7245c1a272\") "
Jul 07 02:27:03.180483 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.180449    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file" (OuterVolumeSpecName: "config-file") pod "42535ec3-1a6e-467b-b6b4-fb7245c1a272" (UID: "42535ec3-1a6e-467b-b6b4-fb7245c1a272"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:27:03.182318 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.182297    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k" (OuterVolumeSpecName: "kube-api-access-csq4k") pod "42535ec3-1a6e-467b-b6b4-fb7245c1a272" (UID: "42535ec3-1a6e-467b-b6b4-fb7245c1a272"). InnerVolumeSpecName "kube-api-access-csq4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:27:03.281479 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.281443    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csq4k\" (UniqueName: \"kubernetes.io/projected/42535ec3-1a6e-467b-b6b4-fb7245c1a272-kube-api-access-csq4k\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:27:03.281479 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.281473    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42535ec3-1a6e-467b-b6b4-fb7245c1a272-config-file\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:27:03.953574 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.953542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws" event={"ID":"42535ec3-1a6e-467b-b6b4-fb7245c1a272","Type":"ContainerDied","Data":"fdc8e3e8b45cd4f61f4bae1ed28d78cacefdc975f37088cec3b1d09cf0b2cd3e"}
Jul 07 02:27:03.953574 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.953560    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wfxws"
Jul 07 02:27:03.953832 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.953597    2559 scope.go:117] "RemoveContainer" containerID="8b8d8b7bb3abad9c9a749d44408f7d51c47ab1c16e97b0bdbeeca9ee56cc988f"
Jul 07 02:27:03.975043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.975013    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:27:03.978747 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:03.978723    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wfxws"]
Jul 07 02:27:05.153483 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:05.153445    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" path="/var/lib/kubelet/pods/42535ec3-1a6e-467b-b6b4-fb7245c1a272/volumes"
Jul 07 02:27:06.604252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.604211    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-jpx2m"]
Jul 07 02:27:06.604750 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.604670    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" containerName="limitador"
Jul 07 02:27:06.604750 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.604689    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" containerName="limitador"
Jul 07 02:27:06.604825 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.604774    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="42535ec3-1a6e-467b-b6b4-fb7245c1a272" containerName="limitador"
Jul 07 02:27:06.609034 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.609016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.612087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.612062    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 02:27:06.613253 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.613229    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bsnpg\""
Jul 07 02:27:06.614062 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.614036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jpx2m"]
Jul 07 02:27:06.711691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.711652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gv4\" (UniqueName: \"kubernetes.io/projected/1a32eed5-6f91-4872-86b6-fb78650deaf3-kube-api-access-76gv4\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.711908 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.711763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a32eed5-6f91-4872-86b6-fb78650deaf3-data\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.812379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.812337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a32eed5-6f91-4872-86b6-fb78650deaf3-data\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.812550 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.812418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76gv4\" (UniqueName: \"kubernetes.io/projected/1a32eed5-6f91-4872-86b6-fb78650deaf3-kube-api-access-76gv4\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.812855 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.812822    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1a32eed5-6f91-4872-86b6-fb78650deaf3-data\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.824738 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.824712    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gv4\" (UniqueName: \"kubernetes.io/projected/1a32eed5-6f91-4872-86b6-fb78650deaf3-kube-api-access-76gv4\") pod \"postgres-69fb4594cf-jpx2m\" (UID: \"1a32eed5-6f91-4872-86b6-fb78650deaf3\") " pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:06.921869 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:06.921782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:07.067083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:07.067039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-jpx2m"]
Jul 07 02:27:07.069188 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:27:07.069158    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a32eed5_6f91_4872_86b6_fb78650deaf3.slice/crio-d53720eb54da801272013deaaac210e3f312e172df64b38a9cb70a6b32ff20c7 WatchSource:0}: Error finding container d53720eb54da801272013deaaac210e3f312e172df64b38a9cb70a6b32ff20c7: Status 404 returned error can't find the container with id d53720eb54da801272013deaaac210e3f312e172df64b38a9cb70a6b32ff20c7
Jul 07 02:27:07.979976 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:07.979942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jpx2m" event={"ID":"1a32eed5-6f91-4872-86b6-fb78650deaf3","Type":"ContainerStarted","Data":"d53720eb54da801272013deaaac210e3f312e172df64b38a9cb70a6b32ff20c7"}
Jul 07 02:27:13.007428 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:13.007392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-jpx2m" event={"ID":"1a32eed5-6f91-4872-86b6-fb78650deaf3","Type":"ContainerStarted","Data":"6db5d48aecbd6c6ab06b58100ac1dc850a90d87bf5165121f8efd5823fce37df"}
Jul 07 02:27:13.007853 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:13.007522    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:13.025387 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:13.025335    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-jpx2m" podStartSLOduration=1.853369572 podStartE2EDuration="7.025317582s" totalImagesPullingTime="5.17194801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:13.024444304 +0000 UTC m=+746.422442639" watchObservedRunningTime="2026-07-07 02:27:13.025317582 +0000 UTC m=+746.423315914"
Jul 07 02:27:19.041498 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.041465    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-jpx2m"
Jul 07 02:27:19.830209 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.830170    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:19.837757 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.837729    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:19.840928 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.840901    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:19.841067 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.840907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qxxrr\""
Jul 07 02:27:19.922462 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:19.922420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn4zg\" (UniqueName: \"kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg\") pod \"authorino-5cc8f4db86-hzl4c\" (UID: \"8cf3c888-c4e0-40eb-a92d-45378deedda8\") " pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:20.023923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:20.023885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn4zg\" (UniqueName: \"kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg\") pod \"authorino-5cc8f4db86-hzl4c\" (UID: \"8cf3c888-c4e0-40eb-a92d-45378deedda8\") " pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:20.033344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:20.033314    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn4zg\" (UniqueName: \"kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg\") pod \"authorino-5cc8f4db86-hzl4c\" (UID: \"8cf3c888-c4e0-40eb-a92d-45378deedda8\") " pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:20.148225 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:20.148146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:20.271331 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:20.271294    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:20.284563 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:20.284539    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:20.287189 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:27:20.287162    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cf3c888_c4e0_40eb_a92d_45378deedda8.slice/crio-a0fbc3ad44144bcfc15f8a8a8873892945c9044be1190b6cdcb758a10afca663 WatchSource:0}: Error finding container a0fbc3ad44144bcfc15f8a8a8873892945c9044be1190b6cdcb758a10afca663: Status 404 returned error can't find the container with id a0fbc3ad44144bcfc15f8a8a8873892945c9044be1190b6cdcb758a10afca663
Jul 07 02:27:21.046086 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:21.046043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" event={"ID":"8cf3c888-c4e0-40eb-a92d-45378deedda8","Type":"ContainerStarted","Data":"a0fbc3ad44144bcfc15f8a8a8873892945c9044be1190b6cdcb758a10afca663"}
Jul 07 02:27:24.064235 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.064193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" event={"ID":"8cf3c888-c4e0-40eb-a92d-45378deedda8","Type":"ContainerStarted","Data":"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"}
Jul 07 02:27:24.064666 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.064257    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" podUID="8cf3c888-c4e0-40eb-a92d-45378deedda8" containerName="authorino" containerID="cri-o://875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f" gracePeriod=30
Jul 07 02:27:24.083379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.083331    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" podStartSLOduration=2.059753187 podStartE2EDuration="5.083315259s" totalImagesPullingTime="3.023562072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:24.082674135 +0000 UTC m=+757.480672468" watchObservedRunningTime="2026-07-07 02:27:24.083315259 +0000 UTC m=+757.481313787"
Jul 07 02:27:24.311279 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.311253    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:24.461581 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.461489    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn4zg\" (UniqueName: \"kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg\") pod \"8cf3c888-c4e0-40eb-a92d-45378deedda8\" (UID: \"8cf3c888-c4e0-40eb-a92d-45378deedda8\") "
Jul 07 02:27:24.463742 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.463712    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg" (OuterVolumeSpecName: "kube-api-access-pn4zg") pod "8cf3c888-c4e0-40eb-a92d-45378deedda8" (UID: "8cf3c888-c4e0-40eb-a92d-45378deedda8"). InnerVolumeSpecName "kube-api-access-pn4zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:27:24.562502 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:24.562462    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn4zg\" (UniqueName: \"kubernetes.io/projected/8cf3c888-c4e0-40eb-a92d-45378deedda8-kube-api-access-pn4zg\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:27:25.070793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.070754    2559 generic.go:356] "Generic (PLEG): container finished" podID="8cf3c888-c4e0-40eb-a92d-45378deedda8" containerID="875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f" exitCode=0
Jul 07 02:27:25.070793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.070794    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c"
Jul 07 02:27:25.071266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.070841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" event={"ID":"8cf3c888-c4e0-40eb-a92d-45378deedda8","Type":"ContainerDied","Data":"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"}
Jul 07 02:27:25.071266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.070878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc8f4db86-hzl4c" event={"ID":"8cf3c888-c4e0-40eb-a92d-45378deedda8","Type":"ContainerDied","Data":"a0fbc3ad44144bcfc15f8a8a8873892945c9044be1190b6cdcb758a10afca663"}
Jul 07 02:27:25.071266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.070894    2559 scope.go:117] "RemoveContainer" containerID="875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"
Jul 07 02:27:25.079622 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.079581    2559 scope.go:117] "RemoveContainer" containerID="875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"
Jul 07 02:27:25.079932 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:27:25.079914    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f\": container with ID starting with 875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f not found: ID does not exist" containerID="875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"
Jul 07 02:27:25.079981 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.079943    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f"} err="failed to get container status \"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f\": rpc error: code = NotFound desc = could not find container \"875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f\": container with ID starting with 875a776825b65227a2eac4d095f7a9ad8cb81418162f43bf76968dbca9a1fe9f not found: ID does not exist"
Jul 07 02:27:25.091303 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.091274    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:25.093814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.093795    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cc8f4db86-hzl4c"]
Jul 07 02:27:25.153915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:25.153873    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf3c888-c4e0-40eb-a92d-45378deedda8" path="/var/lib/kubelet/pods/8cf3c888-c4e0-40eb-a92d-45378deedda8/volumes"
Jul 07 02:27:26.573776 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.573733    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:26.574290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.574177    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf3c888-c4e0-40eb-a92d-45378deedda8" containerName="authorino"
Jul 07 02:27:26.574290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.574194    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf3c888-c4e0-40eb-a92d-45378deedda8" containerName="authorino"
Jul 07 02:27:26.574290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.574285    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf3c888-c4e0-40eb-a92d-45378deedda8" containerName="authorino"
Jul 07 02:27:26.578539 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.578515    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.581552 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.581528    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 02:27:26.581754 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.581727    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rbdbn\""
Jul 07 02:27:26.581819 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.581728    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 02:27:26.587141 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.587115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:26.679367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.679326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqf6\" (UniqueName: \"kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.679367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.679371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.780765 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.780724    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqf6\" (UniqueName: \"kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.780949 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.780781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.780949 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:27:26.780918    2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 02:27:26.781095 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:27:26.780985    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert podName:0a88b6fd-657a-407f-8ecb-414bcc116418 nodeName:}" failed. No retries permitted until 2026-07-07 02:27:27.280964136 +0000 UTC m=+760.678962463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert") pod "maas-controller-697db4d5bb-jb8ch" (UID: "0a88b6fd-657a-407f-8ecb-414bcc116418") : secret "maas-controller-webhook-cert" not found
Jul 07 02:27:26.783575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.783548    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:27:26.786670 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.786653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.831751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.831657    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:27:26.834251 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.834224    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqf6\" (UniqueName: \"kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:26.882020 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.881984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2bs2\" (UniqueName: \"kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.882220 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.882125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.983495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.983459    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2bs2\" (UniqueName: \"kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.983720 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.983545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.986186 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.986154    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:26.993121 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:26.993093    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2bs2\" (UniqueName: \"kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2\") pod \"maas-controller-568f884b76-vd5kt\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") " pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:27.096787 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.096698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:27.238153 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.238126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:27:27.240029 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:27:27.240007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86405804_5ecf_44ba_bf59_a74672c5acba.slice/crio-cc55ec77cdb7e7cedae492e43c22eb7acf311a21d50eae6635aac00a0f1c4a8c WatchSource:0}: Error finding container cc55ec77cdb7e7cedae492e43c22eb7acf311a21d50eae6635aac00a0f1c4a8c: Status 404 returned error can't find the container with id cc55ec77cdb7e7cedae492e43c22eb7acf311a21d50eae6635aac00a0f1c4a8c
Jul 07 02:27:27.286973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.286934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:27.289442 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.289420    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") pod \"maas-controller-697db4d5bb-jb8ch\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") " pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:27.490041 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.490012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:27.626007 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:27.625975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:27.628582 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:27:27.628550    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a88b6fd_657a_407f_8ecb_414bcc116418.slice/crio-b46b78be00c13fd310b5a0d1a746fd016377681d5b213687516557f238145e22 WatchSource:0}: Error finding container b46b78be00c13fd310b5a0d1a746fd016377681d5b213687516557f238145e22: Status 404 returned error can't find the container with id b46b78be00c13fd310b5a0d1a746fd016377681d5b213687516557f238145e22
Jul 07 02:27:28.098628 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:28.098528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" event={"ID":"0a88b6fd-657a-407f-8ecb-414bcc116418","Type":"ContainerStarted","Data":"b46b78be00c13fd310b5a0d1a746fd016377681d5b213687516557f238145e22"}
Jul 07 02:27:28.101254 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:28.101209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-vd5kt" event={"ID":"86405804-5ecf-44ba-bf59-a74672c5acba","Type":"ContainerStarted","Data":"cc55ec77cdb7e7cedae492e43c22eb7acf311a21d50eae6635aac00a0f1c4a8c"}
Jul 07 02:27:30.111923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.111886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" event={"ID":"0a88b6fd-657a-407f-8ecb-414bcc116418","Type":"ContainerStarted","Data":"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"}
Jul 07 02:27:30.112377 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.111950    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:30.113351 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.113325    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-vd5kt" event={"ID":"86405804-5ecf-44ba-bf59-a74672c5acba","Type":"ContainerStarted","Data":"2b26726cc4dbc798b62bb802cec48b2bec24e6095f4678663b267da87e3c78fd"}
Jul 07 02:27:30.113401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.113381    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:30.136739 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.136690    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" podStartSLOduration=2.236720999 podStartE2EDuration="4.136673528s" totalImagesPullingTime="1.899952529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:30.134423443 +0000 UTC m=+763.532421775" watchObservedRunningTime="2026-07-07 02:27:30.136673528 +0000 UTC m=+763.534671859"
Jul 07 02:27:30.178149 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:30.178096    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-568f884b76-vd5kt" podStartSLOduration=1.88250116 podStartE2EDuration="4.178078556s" totalImagesPullingTime="2.295577396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:27:30.175711525 +0000 UTC m=+763.573709896" watchObservedRunningTime="2026-07-07 02:27:30.178078556 +0000 UTC m=+763.576076888"
Jul 07 02:27:41.125342 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.125306    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:27:41.125844 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.125392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:41.183037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.183005    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:41.183288 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.183192    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" podUID="0a88b6fd-657a-407f-8ecb-414bcc116418" containerName="manager" containerID="cri-o://28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5" gracePeriod=30
Jul 07 02:27:41.425093 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.425068    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:41.500083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.500047    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqqf6\" (UniqueName: \"kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6\") pod \"0a88b6fd-657a-407f-8ecb-414bcc116418\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") "
Jul 07 02:27:41.500277 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.500101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") pod \"0a88b6fd-657a-407f-8ecb-414bcc116418\" (UID: \"0a88b6fd-657a-407f-8ecb-414bcc116418\") "
Jul 07 02:27:41.502353 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.502328    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0a88b6fd-657a-407f-8ecb-414bcc116418" (UID: "0a88b6fd-657a-407f-8ecb-414bcc116418"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:27:41.502461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.502440    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6" (OuterVolumeSpecName: "kube-api-access-hqqf6") pod "0a88b6fd-657a-407f-8ecb-414bcc116418" (UID: "0a88b6fd-657a-407f-8ecb-414bcc116418"). InnerVolumeSpecName "kube-api-access-hqqf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:27:41.600858 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.600817    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqqf6\" (UniqueName: \"kubernetes.io/projected/0a88b6fd-657a-407f-8ecb-414bcc116418-kube-api-access-hqqf6\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:27:41.600858 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:41.600850    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a88b6fd-657a-407f-8ecb-414bcc116418-webhook-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:27:42.167769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.167730    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a88b6fd-657a-407f-8ecb-414bcc116418" containerID="28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5" exitCode=0
Jul 07 02:27:42.168170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.167779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-697db4d5bb-jb8ch"
Jul 07 02:27:42.168170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.167823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" event={"ID":"0a88b6fd-657a-407f-8ecb-414bcc116418","Type":"ContainerDied","Data":"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"}
Jul 07 02:27:42.168170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.167881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-697db4d5bb-jb8ch" event={"ID":"0a88b6fd-657a-407f-8ecb-414bcc116418","Type":"ContainerDied","Data":"b46b78be00c13fd310b5a0d1a746fd016377681d5b213687516557f238145e22"}
Jul 07 02:27:42.168170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.167907    2559 scope.go:117] "RemoveContainer" containerID="28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"
Jul 07 02:27:42.177389 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.177369    2559 scope.go:117] "RemoveContainer" containerID="28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"
Jul 07 02:27:42.177698 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:27:42.177676    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5\": container with ID starting with 28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5 not found: ID does not exist" containerID="28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"
Jul 07 02:27:42.177791 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.177706    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5"} err="failed to get container status \"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5\": rpc error: code = NotFound desc = could not find container \"28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5\": container with ID starting with 28f7d61672a275a1813b58e01ab74466da8a1fcd38ec02bd11e507ab8da954f5 not found: ID does not exist"
Jul 07 02:27:42.190370 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.190334    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:42.195379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:42.195340    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-697db4d5bb-jb8ch"]
Jul 07 02:27:43.154063 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:27:43.154027    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a88b6fd-657a-407f-8ecb-414bcc116418" path="/var/lib/kubelet/pods/0a88b6fd-657a-407f-8ecb-414bcc116418/volumes"
Jul 07 02:28:03.458845 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.458813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-667967ddd6-75j5h"]
Jul 07 02:28:03.459217 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.459120    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a88b6fd-657a-407f-8ecb-414bcc116418" containerName="manager"
Jul 07 02:28:03.459217 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.459131    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a88b6fd-657a-407f-8ecb-414bcc116418" containerName="manager"
Jul 07 02:28:03.459217 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.459181    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a88b6fd-657a-407f-8ecb-414bcc116418" containerName="manager"
Jul 07 02:28:03.479869 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.479838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-667967ddd6-75j5h"]
Jul 07 02:28:03.480053 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.479973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.483132 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.483110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gkk4p\""
Jul 07 02:28:03.483484 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.483465    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 02:28:03.588302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.588261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz9mx\" (UniqueName: \"kubernetes.io/projected/711339e7-5444-4213-afe8-f3fcdfbf30f9-kube-api-access-mz9mx\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.588482 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.588310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/711339e7-5444-4213-afe8-f3fcdfbf30f9-maas-api-tls\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.588482 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.588335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/711339e7-5444-4213-afe8-f3fcdfbf30f9-openshift-service-ca\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.689300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.689258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz9mx\" (UniqueName: \"kubernetes.io/projected/711339e7-5444-4213-afe8-f3fcdfbf30f9-kube-api-access-mz9mx\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.689503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.689313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/711339e7-5444-4213-afe8-f3fcdfbf30f9-maas-api-tls\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.689503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.689345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/711339e7-5444-4213-afe8-f3fcdfbf30f9-openshift-service-ca\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.690029 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.690003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/711339e7-5444-4213-afe8-f3fcdfbf30f9-openshift-service-ca\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.691918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.691898    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/711339e7-5444-4213-afe8-f3fcdfbf30f9-maas-api-tls\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.702691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.702667    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz9mx\" (UniqueName: \"kubernetes.io/projected/711339e7-5444-4213-afe8-f3fcdfbf30f9-kube-api-access-mz9mx\") pod \"maas-api-667967ddd6-75j5h\" (UID: \"711339e7-5444-4213-afe8-f3fcdfbf30f9\") " pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.791227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.791188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:03.939319 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:03.939286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-667967ddd6-75j5h"]
Jul 07 02:28:03.942360 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:28:03.942328    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711339e7_5444_4213_afe8_f3fcdfbf30f9.slice/crio-e1750f900adf8c8eb34439de3d63f493bde595fd676a18f0aa6cbe35ee2d393f WatchSource:0}: Error finding container e1750f900adf8c8eb34439de3d63f493bde595fd676a18f0aa6cbe35ee2d393f: Status 404 returned error can't find the container with id e1750f900adf8c8eb34439de3d63f493bde595fd676a18f0aa6cbe35ee2d393f
Jul 07 02:28:04.010286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.010249    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xhskl"]
Jul 07 02:28:04.013364 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.013339    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.016807 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.016780    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 02:28:04.026425 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.026398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xhskl"]
Jul 07 02:28:04.037880 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.037843    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zpnjl"]
Jul 07 02:28:04.040717 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.040686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.048856 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.047659    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ndm8m\""
Jul 07 02:28:04.058488 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.058460    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zpnjl"]
Jul 07 02:28:04.093077 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.093047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtsjk\" (UniqueName: \"kubernetes.io/projected/83789f6d-dc39-46d0-911b-131dea77fb5d-kube-api-access-rtsjk\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.093255 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.093099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83789f6d-dc39-46d0-911b-131dea77fb5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.193867 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.193830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/834ec390-94e3-42a0-a0df-75354a1e08fd-plugins-config-volume\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.194022 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.193887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtsjk\" (UniqueName: \"kubernetes.io/projected/83789f6d-dc39-46d0-911b-131dea77fb5d-kube-api-access-rtsjk\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.194022 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.193963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcc5\" (UniqueName: \"kubernetes.io/projected/834ec390-94e3-42a0-a0df-75354a1e08fd-kube-api-access-wpcc5\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.194022 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.194009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83789f6d-dc39-46d0-911b-131dea77fb5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.194683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.194666    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83789f6d-dc39-46d0-911b-131dea77fb5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.203098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.203068    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtsjk\" (UniqueName: \"kubernetes.io/projected/83789f6d-dc39-46d0-911b-131dea77fb5d-kube-api-access-rtsjk\") pod \"payload-pre-processing-7964457696-xhskl\" (UID: \"83789f6d-dc39-46d0-911b-131dea77fb5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.272011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.271977    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-667967ddd6-75j5h" event={"ID":"711339e7-5444-4213-afe8-f3fcdfbf30f9","Type":"ContainerStarted","Data":"e1750f900adf8c8eb34439de3d63f493bde595fd676a18f0aa6cbe35ee2d393f"}
Jul 07 02:28:04.294450 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.294412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcc5\" (UniqueName: \"kubernetes.io/projected/834ec390-94e3-42a0-a0df-75354a1e08fd-kube-api-access-wpcc5\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.294696 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.294514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/834ec390-94e3-42a0-a0df-75354a1e08fd-plugins-config-volume\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.295274 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.295251    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/834ec390-94e3-42a0-a0df-75354a1e08fd-plugins-config-volume\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.303928 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.303872    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcc5\" (UniqueName: \"kubernetes.io/projected/834ec390-94e3-42a0-a0df-75354a1e08fd-kube-api-access-wpcc5\") pod \"payload-processing-58f86c7798-zpnjl\" (UID: \"834ec390-94e3-42a0-a0df-75354a1e08fd\") " pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.324695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.324657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:04.351957 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.351926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:04.476316 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.476073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-xhskl"]
Jul 07 02:28:04.480137 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:28:04.480102    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83789f6d_dc39_46d0_911b_131dea77fb5d.slice/crio-a6cf9bfc48ec2673ddfdd0f2baf842f23f99f5354b4359dfc4e2da9b017309fa WatchSource:0}: Error finding container a6cf9bfc48ec2673ddfdd0f2baf842f23f99f5354b4359dfc4e2da9b017309fa: Status 404 returned error can't find the container with id a6cf9bfc48ec2673ddfdd0f2baf842f23f99f5354b4359dfc4e2da9b017309fa
Jul 07 02:28:04.511507 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:04.511473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zpnjl"]
Jul 07 02:28:04.515284 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:28:04.515238    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834ec390_94e3_42a0_a0df_75354a1e08fd.slice/crio-e2215ef8330ef6c0ccb664b841f76ef318acfbac58c51319734a93151e1fa87b WatchSource:0}: Error finding container e2215ef8330ef6c0ccb664b841f76ef318acfbac58c51319734a93151e1fa87b: Status 404 returned error can't find the container with id e2215ef8330ef6c0ccb664b841f76ef318acfbac58c51319734a93151e1fa87b
Jul 07 02:28:05.281387 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:05.281329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl" event={"ID":"834ec390-94e3-42a0-a0df-75354a1e08fd","Type":"ContainerStarted","Data":"e2215ef8330ef6c0ccb664b841f76ef318acfbac58c51319734a93151e1fa87b"}
Jul 07 02:28:05.284209 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:05.284080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl" event={"ID":"83789f6d-dc39-46d0-911b-131dea77fb5d","Type":"ContainerStarted","Data":"a6cf9bfc48ec2673ddfdd0f2baf842f23f99f5354b4359dfc4e2da9b017309fa"}
Jul 07 02:28:07.295868 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.295765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-667967ddd6-75j5h" event={"ID":"711339e7-5444-4213-afe8-f3fcdfbf30f9","Type":"ContainerStarted","Data":"37442b90de38119cd584878fe593f8d25b48d07455f485a90d318b4bbd8ea6c8"}
Jul 07 02:28:07.296283 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.295873    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:07.297240 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.297207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl" event={"ID":"834ec390-94e3-42a0-a0df-75354a1e08fd","Type":"ContainerStarted","Data":"b77ebcf4575bd05610ebc7b68450990eb3440349d95918426279bc00c903e93f"}
Jul 07 02:28:07.297383 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.297265    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:07.298658 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.298633    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl" event={"ID":"83789f6d-dc39-46d0-911b-131dea77fb5d","Type":"ContainerStarted","Data":"d1bc719dc10c3aab9c3ba610dea5c234f975b05e258731b8ad2413455f0ea2a3"}
Jul 07 02:28:07.298772 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.298689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:07.315040 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.314993    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-667967ddd6-75j5h" podStartSLOduration=1.8943105390000001 podStartE2EDuration="4.314978093s" totalImagesPullingTime="2.420667554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:07.313930278 +0000 UTC m=+800.711928612" watchObservedRunningTime="2026-07-07 02:28:07.314978093 +0000 UTC m=+800.712976424"
Jul 07 02:28:07.332216 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.332148    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl" podStartSLOduration=2.448236911 podStartE2EDuration="4.332125473s" totalImagesPullingTime="1.883888562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:07.330493692 +0000 UTC m=+800.728492025" watchObservedRunningTime="2026-07-07 02:28:07.332125473 +0000 UTC m=+800.730123819"
Jul 07 02:28:07.352443 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:07.352368    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl" podStartSLOduration=1.5050001370000001 podStartE2EDuration="3.352342031s" totalImagesPullingTime="1.847341894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:07.349924213 +0000 UTC m=+800.747922540" watchObservedRunningTime="2026-07-07 02:28:07.352342031 +0000 UTC m=+800.750340365"
Jul 07 02:28:12.328103 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.328067    2559 generic.go:356] "Generic (PLEG): container finished" podID="b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb" containerID="db425a0b6d654f86fb69b53c16638a2d67fa9ec7049d68e8be6f40f7629ff452" exitCode=0
Jul 07 02:28:12.328549 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.328143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" event={"ID":"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb","Type":"ContainerDied","Data":"db425a0b6d654f86fb69b53c16638a2d67fa9ec7049d68e8be6f40f7629ff452"}
Jul 07 02:28:12.328549 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.328496    2559 scope.go:117] "RemoveContainer" containerID="db425a0b6d654f86fb69b53c16638a2d67fa9ec7049d68e8be6f40f7629ff452"
Jul 07 02:28:12.329405 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.329378    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:28:12.329466 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.329450    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:28:12.329515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:12.329503    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:28:13.308475 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:13.308443    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-667967ddd6-75j5h"
Jul 07 02:28:13.336841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:13.335967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" event={"ID":"b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb","Type":"ContainerStarted","Data":"88fda5d0dc4dc2f9608a34cbe93c41ae16d6d4f99d2c1f0da73486040678188b"}
Jul 07 02:28:13.387682 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:13.387651    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:28:13.387938 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:13.387914    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6pmgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 02:28:13.388082 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:13.387963    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" podUID="b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 02:28:14.388363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:14.388327    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6pmgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 02:28:14.388786 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:14.388379    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" podUID="b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 02:28:15.387985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:15.387948    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6pmgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 02:28:15.388161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:15.388003    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" podUID="b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 02:28:16.388243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:16.388205    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-6pmgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 02:28:16.388675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:16.388278    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx" podUID="b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 02:28:17.392662 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:17.392624    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:28:17.393098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:17.392895    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:28:17.393534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:17.393519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-6pmgx"
Jul 07 02:28:18.304091 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:18.304033    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl" podUID="83789f6d-dc39-46d0-911b-131dea77fb5d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.38:9004: connect: connection refused"
Jul 07 02:28:18.304441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:18.304421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zpnjl"
Jul 07 02:28:23.023583 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.023547    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"]
Jul 07 02:28:23.026393 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.026373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.029732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.029703    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 02:28:23.029891 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.029749    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 02:28:23.029891 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.029786    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 02:28:23.029891 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.029830    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ngg6b\""
Jul 07 02:28:23.035565 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.035541    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"]
Jul 07 02:28:23.161742 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea512196-cb9d-4157-96cc-b372e85d64b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.161923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.161923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.161923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.161923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glv5c\" (UniqueName: \"kubernetes.io/projected/ea512196-cb9d-4157-96cc-b372e85d64b1-kube-api-access-glv5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.161923 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.161892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263554 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea512196-cb9d-4157-96cc-b372e85d64b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263585    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263921 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glv5c\" (UniqueName: \"kubernetes.io/projected/ea512196-cb9d-4157-96cc-b372e85d64b1-kube-api-access-glv5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.263921 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.263822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.269245 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.269208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.269404 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.269298    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.269783 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.269759    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.269884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.269865    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea512196-cb9d-4157-96cc-b372e85d64b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.271730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.271708    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea512196-cb9d-4157-96cc-b372e85d64b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.277783 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.277723    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glv5c\" (UniqueName: \"kubernetes.io/projected/ea512196-cb9d-4157-96cc-b372e85d64b1-kube-api-access-glv5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp\" (UID: \"ea512196-cb9d-4157-96cc-b372e85d64b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.338887 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.338847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:23.483472 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:23.483433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"]
Jul 07 02:28:23.485576 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:28:23.485549    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea512196_cb9d_4157_96cc_b372e85d64b1.slice/crio-6596ff06d4e2a8c92fad5ea2b6e7da97bbfe088fdc171892a9c1f94967e6ae7f WatchSource:0}: Error finding container 6596ff06d4e2a8c92fad5ea2b6e7da97bbfe088fdc171892a9c1f94967e6ae7f: Status 404 returned error can't find the container with id 6596ff06d4e2a8c92fad5ea2b6e7da97bbfe088fdc171892a9c1f94967e6ae7f
Jul 07 02:28:24.401575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:24.401504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp" event={"ID":"ea512196-cb9d-4157-96cc-b372e85d64b1","Type":"ContainerStarted","Data":"6596ff06d4e2a8c92fad5ea2b6e7da97bbfe088fdc171892a9c1f94967e6ae7f"}
Jul 07 02:28:25.407598 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:25.407561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp" event={"ID":"ea512196-cb9d-4157-96cc-b372e85d64b1","Type":"ContainerStarted","Data":"8d8987a40b67d870f53653fe3794f0227653ff65dd49e7dfd63791db6fe54897"}
Jul 07 02:28:25.428646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:25.428574    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp" podStartSLOduration=1.2974993590000001 podStartE2EDuration="2.428557423s" totalImagesPullingTime="1.131058064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:25.426181582 +0000 UTC m=+818.824179918" watchObservedRunningTime="2026-07-07 02:28:25.428557423 +0000 UTC m=+818.826555811"
Jul 07 02:28:28.303691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:28.303659    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-xhskl"
Jul 07 02:28:31.940999 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:31.940954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"]
Jul 07 02:28:31.944207 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:31.944182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:31.947130 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:31.947108    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 02:28:31.952809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:31.952787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"]
Jul 07 02:28:32.141102 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fw5t\" (UniqueName: \"kubernetes.io/projected/248bdf19-a63a-4ceb-a519-1dfbcbd68324-kube-api-access-8fw5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.141102 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.141332 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.141332 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.141332 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.141445 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.141373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.242820 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fw5t\" (UniqueName: \"kubernetes.io/projected/248bdf19-a63a-4ceb-a519-1dfbcbd68324-kube-api-access-8fw5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.242820 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.242964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.243361    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243448 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.243411    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.243501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.243449    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.245271 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.245240    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/248bdf19-a63a-4ceb-a519-1dfbcbd68324-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.245561 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.245544    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/248bdf19-a63a-4ceb-a519-1dfbcbd68324-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.251249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.251220    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fw5t\" (UniqueName: \"kubernetes.io/projected/248bdf19-a63a-4ceb-a519-1dfbcbd68324-kube-api-access-8fw5t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-z52lt\" (UID: \"248bdf19-a63a-4ceb-a519-1dfbcbd68324\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.256127 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.256106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:32.447042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:32.447015    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"]
Jul 07 02:28:32.448155 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:28:32.448130    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248bdf19_a63a_4ceb_a519_1dfbcbd68324.slice/crio-af15235744a9b51d867ac37187b331d5106676d42a39a75edcada9ec6bb77fb0 WatchSource:0}: Error finding container af15235744a9b51d867ac37187b331d5106676d42a39a75edcada9ec6bb77fb0: Status 404 returned error can't find the container with id af15235744a9b51d867ac37187b331d5106676d42a39a75edcada9ec6bb77fb0
Jul 07 02:28:33.339820 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.339781    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:33.340300 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.339872    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:33.352752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.352723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:33.453849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.453810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt" event={"ID":"248bdf19-a63a-4ceb-a519-1dfbcbd68324","Type":"ContainerStarted","Data":"415a779092fc4faf530aad325f196dca71dc9bd6d4e952c15c14e0a59cf80a95"}
Jul 07 02:28:33.454045 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.453872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt" event={"ID":"248bdf19-a63a-4ceb-a519-1dfbcbd68324","Type":"ContainerStarted","Data":"af15235744a9b51d867ac37187b331d5106676d42a39a75edcada9ec6bb77fb0"}
Jul 07 02:28:33.465435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.465406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp"
Jul 07 02:28:33.472527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:33.472462    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt" podStartSLOduration=2.297953904 podStartE2EDuration="2.472448457s" totalImagesPullingTime="174.494553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:28:33.471451467 +0000 UTC m=+826.869449799" watchObservedRunningTime="2026-07-07 02:28:33.472448457 +0000 UTC m=+826.870446790"
Jul 07 02:28:42.257168 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:42.257118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:42.257599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:42.257210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:42.269676 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:42.269647    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:28:42.504232 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:28:42.504200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-z52lt"
Jul 07 02:29:18.944247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:18.944208    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"]
Jul 07 02:29:18.947802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:18.947778    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:18.950841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:18.950819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 02:29:18.957566 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:18.957539    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"]
Jul 07 02:29:19.061232 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec42f714-13a0-412c-aad9-40974c22567e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.061412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghbft\" (UniqueName: \"kubernetes.io/projected/ec42f714-13a0-412c-aad9-40974c22567e-kube-api-access-ghbft\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.061412 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.061508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.061552 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.061596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.061576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.162862 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.162826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.162875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.162915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.162953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec42f714-13a0-412c-aad9-40974c22567e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.162986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghbft\" (UniqueName: \"kubernetes.io/projected/ec42f714-13a0-412c-aad9-40974c22567e-kube-api-access-ghbft\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.163199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.163260    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.163332    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.163505 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.163486    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.165363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.165341    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec42f714-13a0-412c-aad9-40974c22567e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.165636 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.165596    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec42f714-13a0-412c-aad9-40974c22567e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.173313 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.173287    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghbft\" (UniqueName: \"kubernetes.io/projected/ec42f714-13a0-412c-aad9-40974c22567e-kube-api-access-ghbft\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pk5vp\" (UID: \"ec42f714-13a0-412c-aad9-40974c22567e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.258878 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.258844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:19.399221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.399186    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"]
Jul 07 02:29:19.412946 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:29:19.412916    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec42f714_13a0_412c_aad9_40974c22567e.slice/crio-49be7761efc6a5988fd6a5d91ed66d060e2423b33c9ad8b47cc205242a4ec66b WatchSource:0}: Error finding container 49be7761efc6a5988fd6a5d91ed66d060e2423b33c9ad8b47cc205242a4ec66b: Status 404 returned error can't find the container with id 49be7761efc6a5988fd6a5d91ed66d060e2423b33c9ad8b47cc205242a4ec66b
Jul 07 02:29:19.664759 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.664724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp" event={"ID":"ec42f714-13a0-412c-aad9-40974c22567e","Type":"ContainerStarted","Data":"2e008004123a7bca14e3ad521506b770dbba299e0e205b133943c40c727b108e"}
Jul 07 02:29:19.664922 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.664795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp" event={"ID":"ec42f714-13a0-412c-aad9-40974c22567e","Type":"ContainerStarted","Data":"49be7761efc6a5988fd6a5d91ed66d060e2423b33c9ad8b47cc205242a4ec66b"}
Jul 07 02:29:19.689676 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:19.689623    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp" podStartSLOduration=1.52204286 podStartE2EDuration="1.689586853s" totalImagesPullingTime="167.543993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:29:19.689528688 +0000 UTC m=+873.087527020" watchObservedRunningTime="2026-07-07 02:29:19.689586853 +0000 UTC m=+873.087585247"
Jul 07 02:29:29.259036 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:29.258990    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:29.259441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:29.259067    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:29.271766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:29.271739    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:29:29.722975 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:29:29.722881    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pk5vp"
Jul 07 02:30:00.148175 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.148139    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-wkrjw"]
Jul 07 02:30:00.151839 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.151819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:00.160097 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.160064    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-wkrjw"]
Jul 07 02:30:00.321403 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.321361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fcqn\" (UniqueName: \"kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn\") pod \"maas-api-key-cleanup-29723190-wkrjw\" (UID: \"d12e534e-38a2-4a25-870e-2496825f92d8\") " pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:00.422540 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.422439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fcqn\" (UniqueName: \"kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn\") pod \"maas-api-key-cleanup-29723190-wkrjw\" (UID: \"d12e534e-38a2-4a25-870e-2496825f92d8\") " pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:00.432698 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.432658    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fcqn\" (UniqueName: \"kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn\") pod \"maas-api-key-cleanup-29723190-wkrjw\" (UID: \"d12e534e-38a2-4a25-870e-2496825f92d8\") " pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:00.464761 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.464720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:00.607353 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.607275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723190-wkrjw"]
Jul 07 02:30:00.609764 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:30:00.609732    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12e534e_38a2_4a25_870e_2496825f92d8.slice/crio-788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa WatchSource:0}: Error finding container 788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa: Status 404 returned error can't find the container with id 788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa
Jul 07 02:30:00.863943 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:00.863904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw" event={"ID":"d12e534e-38a2-4a25-870e-2496825f92d8","Type":"ContainerStarted","Data":"788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa"}
Jul 07 02:30:03.878775 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:03.878737    2559 generic.go:356] "Generic (PLEG): container finished" podID="d12e534e-38a2-4a25-870e-2496825f92d8" containerID="9a7b4b44cb6a52f7008cfd6af606f779636771eab24c99d748ea570b910c03af" exitCode=0
Jul 07 02:30:03.879159 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:03.878823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw" event={"ID":"d12e534e-38a2-4a25-870e-2496825f92d8","Type":"ContainerDied","Data":"9a7b4b44cb6a52f7008cfd6af606f779636771eab24c99d748ea570b910c03af"}
Jul 07 02:30:05.021114 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.021084    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:05.162678 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.162555    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fcqn\" (UniqueName: \"kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn\") pod \"d12e534e-38a2-4a25-870e-2496825f92d8\" (UID: \"d12e534e-38a2-4a25-870e-2496825f92d8\") "
Jul 07 02:30:05.164752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.164725    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn" (OuterVolumeSpecName: "kube-api-access-8fcqn") pod "d12e534e-38a2-4a25-870e-2496825f92d8" (UID: "d12e534e-38a2-4a25-870e-2496825f92d8"). InnerVolumeSpecName "kube-api-access-8fcqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:30:05.263467 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.263428    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fcqn\" (UniqueName: \"kubernetes.io/projected/d12e534e-38a2-4a25-870e-2496825f92d8-kube-api-access-8fcqn\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:30:05.889133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.889099    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw"
Jul 07 02:30:05.889312 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.889131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723190-wkrjw" event={"ID":"d12e534e-38a2-4a25-870e-2496825f92d8","Type":"ContainerDied","Data":"788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa"}
Jul 07 02:30:05.889312 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:30:05.889178    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="788e7e31f0aa3090a3962330cf6e8550f522b8481edc7b5d9acbc8bb2d62eeaa"
Jul 07 02:31:40.118983 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.118945    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:31:40.119522 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.119146    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-568f884b76-vd5kt" podUID="86405804-5ecf-44ba-bf59-a74672c5acba" containerName="manager" containerID="cri-o://2b26726cc4dbc798b62bb802cec48b2bec24e6095f4678663b267da87e3c78fd" gracePeriod=30
Jul 07 02:31:40.352738 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.352706    2559 generic.go:356] "Generic (PLEG): container finished" podID="86405804-5ecf-44ba-bf59-a74672c5acba" containerID="2b26726cc4dbc798b62bb802cec48b2bec24e6095f4678663b267da87e3c78fd" exitCode=0
Jul 07 02:31:40.352899 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.352788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-vd5kt" event={"ID":"86405804-5ecf-44ba-bf59-a74672c5acba","Type":"ContainerDied","Data":"2b26726cc4dbc798b62bb802cec48b2bec24e6095f4678663b267da87e3c78fd"}
Jul 07 02:31:40.375705 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.375640    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:31:40.495882 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.495843    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2bs2\" (UniqueName: \"kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2\") pod \"86405804-5ecf-44ba-bf59-a74672c5acba\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") "
Jul 07 02:31:40.496051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.495907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert\") pod \"86405804-5ecf-44ba-bf59-a74672c5acba\" (UID: \"86405804-5ecf-44ba-bf59-a74672c5acba\") "
Jul 07 02:31:40.498162 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.498124    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2" (OuterVolumeSpecName: "kube-api-access-r2bs2") pod "86405804-5ecf-44ba-bf59-a74672c5acba" (UID: "86405804-5ecf-44ba-bf59-a74672c5acba"). InnerVolumeSpecName "kube-api-access-r2bs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:31:40.498282 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.498226    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "86405804-5ecf-44ba-bf59-a74672c5acba" (UID: "86405804-5ecf-44ba-bf59-a74672c5acba"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:31:40.596919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.596867    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2bs2\" (UniqueName: \"kubernetes.io/projected/86405804-5ecf-44ba-bf59-a74672c5acba-kube-api-access-r2bs2\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:31:40.596919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:40.596913    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86405804-5ecf-44ba-bf59-a74672c5acba-webhook-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:31:41.358860 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:41.358827    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-vd5kt"
Jul 07 02:31:41.359258 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:41.358868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-vd5kt" event={"ID":"86405804-5ecf-44ba-bf59-a74672c5acba","Type":"ContainerDied","Data":"cc55ec77cdb7e7cedae492e43c22eb7acf311a21d50eae6635aac00a0f1c4a8c"}
Jul 07 02:31:41.359258 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:41.358931    2559 scope.go:117] "RemoveContainer" containerID="2b26726cc4dbc798b62bb802cec48b2bec24e6095f4678663b267da87e3c78fd"
Jul 07 02:31:41.378298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:41.378267    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:31:41.379953 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:41.379932    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-568f884b76-vd5kt"]
Jul 07 02:31:42.150854 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.150817    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-568f884b76-wmmwc"]
Jul 07 02:31:42.151153 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151141    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d12e534e-38a2-4a25-870e-2496825f92d8" containerName="cleanup"
Jul 07 02:31:42.151196 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151155    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d12e534e-38a2-4a25-870e-2496825f92d8" containerName="cleanup"
Jul 07 02:31:42.151196 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151185    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86405804-5ecf-44ba-bf59-a74672c5acba" containerName="manager"
Jul 07 02:31:42.151196 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151191    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="86405804-5ecf-44ba-bf59-a74672c5acba" containerName="manager"
Jul 07 02:31:42.151291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151243    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="86405804-5ecf-44ba-bf59-a74672c5acba" containerName="manager"
Jul 07 02:31:42.151291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.151250    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d12e534e-38a2-4a25-870e-2496825f92d8" containerName="cleanup"
Jul 07 02:31:42.154245 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.154221    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.158746 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.158712    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rbdbn\""
Jul 07 02:31:42.158921 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.158747    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 02:31:42.158921 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.158725    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 02:31:42.162732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.162698    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568f884b76-wmmwc"]
Jul 07 02:31:42.311100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.311060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddg4q\" (UniqueName: \"kubernetes.io/projected/58451629-373f-4792-bff4-9305b9b7c842-kube-api-access-ddg4q\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.311292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.311131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58451629-373f-4792-bff4-9305b9b7c842-webhook-cert\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.412262 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.412165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddg4q\" (UniqueName: \"kubernetes.io/projected/58451629-373f-4792-bff4-9305b9b7c842-kube-api-access-ddg4q\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.412262 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.412228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58451629-373f-4792-bff4-9305b9b7c842-webhook-cert\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.414920 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.414894    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58451629-373f-4792-bff4-9305b9b7c842-webhook-cert\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.421284 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.421254    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddg4q\" (UniqueName: \"kubernetes.io/projected/58451629-373f-4792-bff4-9305b9b7c842-kube-api-access-ddg4q\") pod \"maas-controller-568f884b76-wmmwc\" (UID: \"58451629-373f-4792-bff4-9305b9b7c842\") " pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.466233 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.466200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:42.604691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.604663    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-568f884b76-wmmwc"]
Jul 07 02:31:42.606122 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:31:42.606095    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58451629_373f_4792_bff4_9305b9b7c842.slice/crio-a3aec8d2d01ea24a9b49f3f92a3fb9ed391fe81d723234c6fcf68196b780c5b6 WatchSource:0}: Error finding container a3aec8d2d01ea24a9b49f3f92a3fb9ed391fe81d723234c6fcf68196b780c5b6: Status 404 returned error can't find the container with id a3aec8d2d01ea24a9b49f3f92a3fb9ed391fe81d723234c6fcf68196b780c5b6
Jul 07 02:31:42.607360 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:42.607342    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:31:43.156592 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:43.156557    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86405804-5ecf-44ba-bf59-a74672c5acba" path="/var/lib/kubelet/pods/86405804-5ecf-44ba-bf59-a74672c5acba/volumes"
Jul 07 02:31:43.370972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:43.370880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-wmmwc" event={"ID":"58451629-373f-4792-bff4-9305b9b7c842","Type":"ContainerStarted","Data":"6b90bba507d6d22cf1630236b0fae393c09f9d92bfa635c20e7e9e226690c074"}
Jul 07 02:31:43.370972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:43.370925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-568f884b76-wmmwc" event={"ID":"58451629-373f-4792-bff4-9305b9b7c842","Type":"ContainerStarted","Data":"a3aec8d2d01ea24a9b49f3f92a3fb9ed391fe81d723234c6fcf68196b780c5b6"}
Jul 07 02:31:43.370972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:43.370955    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:31:43.392292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:43.392236    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-568f884b76-wmmwc" podStartSLOduration=0.9413806 podStartE2EDuration="1.392214117s" totalImagesPullingTime="450.833517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:31:43.390676902 +0000 UTC m=+1016.788675234" watchObservedRunningTime="2026-07-07 02:31:43.392214117 +0000 UTC m=+1016.790212445"
Jul 07 02:31:54.381547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:31:54.381509    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-568f884b76-wmmwc"
Jul 07 02:36:22.296527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:22.296485    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:36:22.297077 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:22.296731    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" podUID="1d52df29-53e7-43a4-a35e-a907f6165d59" containerName="manager" containerID="cri-o://03831eb6dc3c1f343f13118df98112ada7a5674261330395c6e793af0885dbec" gracePeriod=10
Jul 07 02:36:24.718972 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.718942    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d52df29-53e7-43a4-a35e-a907f6165d59" containerID="03831eb6dc3c1f343f13118df98112ada7a5674261330395c6e793af0885dbec" exitCode=0
Jul 07 02:36:24.719324 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.719015    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" event={"ID":"1d52df29-53e7-43a4-a35e-a907f6165d59","Type":"ContainerDied","Data":"03831eb6dc3c1f343f13118df98112ada7a5674261330395c6e793af0885dbec"}
Jul 07 02:36:24.848170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.848147    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:36:24.998194 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.998153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume\") pod \"1d52df29-53e7-43a4-a35e-a907f6165d59\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") "
Jul 07 02:36:24.998385 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.998232    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6khz\" (UniqueName: \"kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz\") pod \"1d52df29-53e7-43a4-a35e-a907f6165d59\" (UID: \"1d52df29-53e7-43a4-a35e-a907f6165d59\") "
Jul 07 02:36:24.998576 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:24.998553    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d52df29-53e7-43a4-a35e-a907f6165d59" (UID: "1d52df29-53e7-43a4-a35e-a907f6165d59"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:36:25.000396 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.000375    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz" (OuterVolumeSpecName: "kube-api-access-k6khz") pod "1d52df29-53e7-43a4-a35e-a907f6165d59" (UID: "1d52df29-53e7-43a4-a35e-a907f6165d59"). InnerVolumeSpecName "kube-api-access-k6khz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:36:25.099019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.098964    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6khz\" (UniqueName: \"kubernetes.io/projected/1d52df29-53e7-43a4-a35e-a907f6165d59-kube-api-access-k6khz\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:36:25.099019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.099009    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d52df29-53e7-43a4-a35e-a907f6165d59-extensions-socket-volume\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:36:25.725447 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.725413    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"
Jul 07 02:36:25.725937 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.725455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq" event={"ID":"1d52df29-53e7-43a4-a35e-a907f6165d59","Type":"ContainerDied","Data":"f10824bb20a43126a9f2fe5c4bbc2173c5be0e11f2863f8b5eb38cd9528c24e7"}
Jul 07 02:36:25.725937 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.725526    2559 scope.go:117] "RemoveContainer" containerID="03831eb6dc3c1f343f13118df98112ada7a5674261330395c6e793af0885dbec"
Jul 07 02:36:25.745929 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.745900    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:36:25.750162 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:25.750137    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvlwq"]
Jul 07 02:36:27.154287 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:36:27.154250    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d52df29-53e7-43a4-a35e-a907f6165d59" path="/var/lib/kubelet/pods/1d52df29-53e7-43a4-a35e-a907f6165d59/volumes"
Jul 07 02:37:23.452569 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.452476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"]
Jul 07 02:37:23.453043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.452924    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d52df29-53e7-43a4-a35e-a907f6165d59" containerName="manager"
Jul 07 02:37:23.453043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.452938    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d52df29-53e7-43a4-a35e-a907f6165d59" containerName="manager"
Jul 07 02:37:23.453043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.452993    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d52df29-53e7-43a4-a35e-a907f6165d59" containerName="manager"
Jul 07 02:37:23.455858 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.455837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.458962 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.458944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9l8b\""
Jul 07 02:37:23.469118 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.469087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"]
Jul 07 02:37:23.594445 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.594398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8gn8\" (UniqueName: \"kubernetes.io/projected/b68d03f6-14ce-43e3-a370-bafef66e0c7c-kube-api-access-v8gn8\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.594684 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.594520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b68d03f6-14ce-43e3-a370-bafef66e0c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.695705 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.695650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b68d03f6-14ce-43e3-a370-bafef66e0c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.695910 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.695739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8gn8\" (UniqueName: \"kubernetes.io/projected/b68d03f6-14ce-43e3-a370-bafef66e0c7c-kube-api-access-v8gn8\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.696108 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.696082    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b68d03f6-14ce-43e3-a370-bafef66e0c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.705726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.705667    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8gn8\" (UniqueName: \"kubernetes.io/projected/b68d03f6-14ce-43e3-a370-bafef66e0c7c-kube-api-access-v8gn8\") pod \"kuadrant-operator-controller-manager-86878c769f-ksqxb\" (UID: \"b68d03f6-14ce-43e3-a370-bafef66e0c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.768729 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.768689    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:23.913172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.913146    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"]
Jul 07 02:37:23.915574 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:37:23.915536    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68d03f6_14ce_43e3_a370_bafef66e0c7c.slice/crio-efd22706b8d06ed96a8ecad5aa6431003d83104073fedcb3503f90910edbf734 WatchSource:0}: Error finding container efd22706b8d06ed96a8ecad5aa6431003d83104073fedcb3503f90910edbf734: Status 404 returned error can't find the container with id efd22706b8d06ed96a8ecad5aa6431003d83104073fedcb3503f90910edbf734
Jul 07 02:37:23.994356 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.994323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb" event={"ID":"b68d03f6-14ce-43e3-a370-bafef66e0c7c","Type":"ContainerStarted","Data":"2e923d153e05d88d85d8113ca14b02ab99fa59c82cfcc01fd6b34de52532d253"}
Jul 07 02:37:23.994500 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.994376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb" event={"ID":"b68d03f6-14ce-43e3-a370-bafef66e0c7c","Type":"ContainerStarted","Data":"efd22706b8d06ed96a8ecad5aa6431003d83104073fedcb3503f90910edbf734"}
Jul 07 02:37:23.994500 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:23.994478    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:37:24.018186 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:24.018133    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb" podStartSLOduration=1.018115529 podStartE2EDuration="1.018115529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:37:24.017353892 +0000 UTC m=+1357.415352225" watchObservedRunningTime="2026-07-07 02:37:24.018115529 +0000 UTC m=+1357.416113861"
Jul 07 02:37:35.001993 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:37:35.001960    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ksqxb"
Jul 07 02:43:32.894034 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.893916    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:32.898375 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.898349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.901948 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.901923    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fdac0d57-openshift-default-dockercfg-spmhc\""
Jul 07 02:43:32.921624 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.921571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:32.979804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.979766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980016 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.979815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980016 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.979834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980016 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.979934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980016 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.979988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980185 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.980060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhtb\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980185 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.980110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980185 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.980141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:32.980298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:32.980190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.080715 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.080677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.080936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.080732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.080936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.080754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhtb\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.080936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.080863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.080936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.080902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081172 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081328 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081283    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081494 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081468    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081578 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081574    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.081683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.081656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.083290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.083270    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.083602 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.083583    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.089503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.089472    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.089664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.089586    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhtb\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb\") pod \"e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") " pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.210898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.210795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:33.351491 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.351460    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:33.353644 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:43:33.353591    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3341ed16_b3e5_4b04_9927_40c53862ff19.slice/crio-2bd263ae7bfb990cb7f53c891e88eb8bbc253ed5492e0df4aa510a6b6bceb29a WatchSource:0}: Error finding container 2bd263ae7bfb990cb7f53c891e88eb8bbc253ed5492e0df4aa510a6b6bceb29a: Status 404 returned error can't find the container with id 2bd263ae7bfb990cb7f53c891e88eb8bbc253ed5492e0df4aa510a6b6bceb29a
Jul 07 02:43:33.355977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.355939    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:43:33.356092 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.356023    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:43:33.356092 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.356073    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:43:33.753793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.753751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" event={"ID":"3341ed16-b3e5-4b04-9927-40c53862ff19","Type":"ContainerStarted","Data":"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"}
Jul 07 02:43:33.754013 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.753820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" event={"ID":"3341ed16-b3e5-4b04-9927-40c53862ff19","Type":"ContainerStarted","Data":"2bd263ae7bfb990cb7f53c891e88eb8bbc253ed5492e0df4aa510a6b6bceb29a"}
Jul 07 02:43:33.777244 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:33.777182    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" podStartSLOduration=1.777166717 podStartE2EDuration="1.777166717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:33.775217398 +0000 UTC m=+1727.173215731" watchObservedRunningTime="2026-07-07 02:43:33.777166717 +0000 UTC m=+1727.175165049"
Jul 07 02:43:34.211645 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.211520    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:34.216509 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.216483    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:34.286086 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.286049    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:34.289378 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.289352    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.293416 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.293390    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-fdac0d57-serving-cert\""
Jul 07 02:43:34.302077 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.302040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:34.391710 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.391661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.391898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.391772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llf9m\" (UniqueName: \"kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.391898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.391844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.492672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.492637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llf9m\" (UniqueName: \"kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.492867 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.492721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.492867 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.492749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.492942 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:34.492860    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-fdac0d57-serving-cert: secret "maas-api-e2e-ait-fdac0d57-serving-cert" not found
Jul 07 02:43:34.492942 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:34.492935    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls podName:f7cffe94-8e4d-4b2a-a908-5be7d65b07dc nodeName:}" failed. No retries permitted until 2026-07-07 02:43:34.992914333 +0000 UTC m=+1728.390912645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls") pod "maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" (UID: "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc") : secret "maas-api-e2e-ait-fdac0d57-serving-cert" not found
Jul 07 02:43:34.493322 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.493305    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.502894 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.502860    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llf9m\" (UniqueName: \"kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.763742 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.763636    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:34.764773 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.764750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:34.996570 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.996531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:34.999324 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:34.999287    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") pod \"maas-api-e2e-ait-fdac0d57-7749c7789-xstj4\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") " pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:35.202443 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:35.202363    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:35.351755 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:35.351721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:35.353329 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:43:35.353301    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cffe94_8e4d_4b2a_a908_5be7d65b07dc.slice/crio-5dbe9296104064bd151235879a332ff591373728bb6d9673b30520fdebb482c3 WatchSource:0}: Error finding container 5dbe9296104064bd151235879a332ff591373728bb6d9673b30520fdebb482c3: Status 404 returned error can't find the container with id 5dbe9296104064bd151235879a332ff591373728bb6d9673b30520fdebb482c3
Jul 07 02:43:35.355002 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:35.354977    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:43:35.768620 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:35.768567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" event={"ID":"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc","Type":"ContainerStarted","Data":"5dbe9296104064bd151235879a332ff591373728bb6d9673b30520fdebb482c3"}
Jul 07 02:43:36.775517 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:36.775469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" event={"ID":"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc","Type":"ContainerStarted","Data":"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"}
Jul 07 02:43:36.797098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:36.797049    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" podStartSLOduration=2.265909664 podStartE2EDuration="2.797032975s" totalImagesPullingTime="531.123311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:36.795073946 +0000 UTC m=+1730.193072278" watchObservedRunningTime="2026-07-07 02:43:36.797032975 +0000 UTC m=+1730.195031331"
Jul 07 02:43:37.780893 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:37.780864    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:39.303519 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:39.303478    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:39.304037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:39.303738    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" podUID="3341ed16-b3e5-4b04-9927-40c53862ff19" containerName="istio-proxy" containerID="cri-o://bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565" gracePeriod=30
Jul 07 02:43:39.518901 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:39.518864    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:39.790047 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:39.789997    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" podUID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" containerName="maas-api" containerID="cri-o://0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2" gracePeriod=30
Jul 07 02:43:40.087786 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.087760    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:40.164078 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.164024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") pod \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") "
Jul 07 02:43:40.164078 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.164098    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llf9m\" (UniqueName: \"kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m\") pod \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") "
Jul 07 02:43:40.164340 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.164139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca\") pod \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\" (UID: \"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc\") "
Jul 07 02:43:40.164517 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.164489    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" (UID: "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:43:40.166324 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.166303    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" (UID: "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:43:40.166396 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.166369    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m" (OuterVolumeSpecName: "kube-api-access-llf9m") pod "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" (UID: "f7cffe94-8e4d-4b2a-a908-5be7d65b07dc"). InnerVolumeSpecName "kube-api-access-llf9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:43:40.265211 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.265166    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:40.265211 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.265199    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:40.265211 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.265210    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llf9m\" (UniqueName: \"kubernetes.io/projected/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc-kube-api-access-llf9m\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:40.796884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.796849    2559 generic.go:356] "Generic (PLEG): container finished" podID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" containerID="0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2" exitCode=0
Jul 07 02:43:40.797368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.796900    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"
Jul 07 02:43:40.797368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.796942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" event={"ID":"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc","Type":"ContainerDied","Data":"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"}
Jul 07 02:43:40.797368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.796997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4" event={"ID":"f7cffe94-8e4d-4b2a-a908-5be7d65b07dc","Type":"ContainerDied","Data":"5dbe9296104064bd151235879a332ff591373728bb6d9673b30520fdebb482c3"}
Jul 07 02:43:40.797368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.797023    2559 scope.go:117] "RemoveContainer" containerID="0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"
Jul 07 02:43:40.806877 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.806851    2559 scope.go:117] "RemoveContainer" containerID="0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"
Jul 07 02:43:40.807196 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:40.807173    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2\": container with ID starting with 0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2 not found: ID does not exist" containerID="0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"
Jul 07 02:43:40.807270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.807207    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2"} err="failed to get container status \"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2\": rpc error: code = NotFound desc = could not find container \"0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2\": container with ID starting with 0b545b91a99071a3991ee98b93232eb6e23e6c1f108d0618538b3830c7eec7d2 not found: ID does not exist"
Jul 07 02:43:40.824238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.824207    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:40.830433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:40.830407    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-fdac0d57-7749c7789-xstj4"]
Jul 07 02:43:41.159122 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:41.159035    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" path="/var/lib/kubelet/pods/f7cffe94-8e4d-4b2a-a908-5be7d65b07dc/volumes"
Jul 07 02:43:45.769461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.769432    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:45.816051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816016    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dhtb\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816080    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816154    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816203    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816239    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816296    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token\") pod \"3341ed16-b3e5-4b04-9927-40c53862ff19\" (UID: \"3341ed16-b3e5-4b04-9927-40c53862ff19\") "
Jul 07 02:43:45.816814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816400    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:43:45.816814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816650    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.816931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816815    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:43:45.816931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816826    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:43:45.816931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.816883    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:43:45.817135 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.817069    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data" (OuterVolumeSpecName: "istio-data") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:43:45.819247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.819190    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:43:45.819400 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.819259    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:43:45.819680 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.819648    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb" (OuterVolumeSpecName: "kube-api-access-9dhtb") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "kube-api-access-9dhtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:43:45.819989 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.819968    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token" (OuterVolumeSpecName: "istio-token") pod "3341ed16-b3e5-4b04-9927-40c53862ff19" (UID: "3341ed16-b3e5-4b04-9927-40c53862ff19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:43:45.824915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.824668    2559 generic.go:356] "Generic (PLEG): container finished" podID="3341ed16-b3e5-4b04-9927-40c53862ff19" containerID="bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565" exitCode=0
Jul 07 02:43:45.824915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.824720    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"
Jul 07 02:43:45.824915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.824720    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" event={"ID":"3341ed16-b3e5-4b04-9927-40c53862ff19","Type":"ContainerDied","Data":"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"}
Jul 07 02:43:45.824915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.824846    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l" event={"ID":"3341ed16-b3e5-4b04-9927-40c53862ff19","Type":"ContainerDied","Data":"2bd263ae7bfb990cb7f53c891e88eb8bbc253ed5492e0df4aa510a6b6bceb29a"}
Jul 07 02:43:45.824915 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.824879    2559 scope.go:117] "RemoveContainer" containerID="bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"
Jul 07 02:43:45.837697 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.837674    2559 scope.go:117] "RemoveContainer" containerID="bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"
Jul 07 02:43:45.838025 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:45.838005    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565\": container with ID starting with bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565 not found: ID does not exist" containerID="bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"
Jul 07 02:43:45.838088 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.838033    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565"} err="failed to get container status \"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565\": rpc error: code = NotFound desc = could not find container \"bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565\": container with ID starting with bc686f4b963b1749f806e5adef55ed52b56a1cd6179fc10c12985e2fd792a565 not found: ID does not exist"
Jul 07 02:43:45.850527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.850394    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:45.852087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.852064    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fdac0d57-openshift-default-6d47677699-gf76l"]
Jul 07 02:43:45.917717 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917669    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhtb\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-kube-api-access-9dhtb\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917717 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917708    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917717 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917721    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917731    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3341ed16-b3e5-4b04-9927-40c53862ff19-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917742    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917753    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917763    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:45.917982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:45.917773    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3341ed16-b3e5-4b04-9927-40c53862ff19-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:46.574691 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.574659    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:46.575270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575159    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" containerName="maas-api"
Jul 07 02:43:46.575270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575185    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" containerName="maas-api"
Jul 07 02:43:46.575270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575226    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3341ed16-b3e5-4b04-9927-40c53862ff19" containerName="istio-proxy"
Jul 07 02:43:46.575270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575234    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3341ed16-b3e5-4b04-9927-40c53862ff19" containerName="istio-proxy"
Jul 07 02:43:46.575599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575329    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3341ed16-b3e5-4b04-9927-40c53862ff19" containerName="istio-proxy"
Jul 07 02:43:46.575599 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.575340    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cffe94-8e4d-4b2a-a908-5be7d65b07dc" containerName="maas-api"
Jul 07 02:43:46.579702 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.579678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.583386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.583364    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f3a52fbf-serving-cert\""
Jul 07 02:43:46.591835 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.591808    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:46.623176 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.623136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.623379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.623198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-758db\" (UniqueName: \"kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.623379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.623333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.724177 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.724132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-758db\" (UniqueName: \"kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.724401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.724218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.724401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.724256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.724401 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:46.724378    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-f3a52fbf-serving-cert: secret "maas-api-e2e-ait-f3a52fbf-serving-cert" not found
Jul 07 02:43:46.724565 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:46.724460    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls podName:0bc44c3c-d5a6-4b9c-b746-cc300be867e4 nodeName:}" failed. No retries permitted until 2026-07-07 02:43:47.224438696 +0000 UTC m=+1740.622437007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls") pod "maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" (UID: "0bc44c3c-d5a6-4b9c-b746-cc300be867e4") : secret "maas-api-e2e-ait-f3a52fbf-serving-cert" not found
Jul 07 02:43:46.725013 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.724993    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:46.733931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:46.733902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-758db\" (UniqueName: \"kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:47.155188 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.155152    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3341ed16-b3e5-4b04-9927-40c53862ff19" path="/var/lib/kubelet/pods/3341ed16-b3e5-4b04-9927-40c53862ff19/volumes"
Jul 07 02:43:47.229108 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.229065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:47.231713 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.231692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") pod \"maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") " pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:47.494369 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.494340    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:47.646267 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.646237    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:47.648378 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:43:47.648347    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc44c3c_d5a6_4b9c_b746_cc300be867e4.slice/crio-798d72ee2e9160302486386468277e9ec17919874f871c0f3eb13a68520284be WatchSource:0}: Error finding container 798d72ee2e9160302486386468277e9ec17919874f871c0f3eb13a68520284be: Status 404 returned error can't find the container with id 798d72ee2e9160302486386468277e9ec17919874f871c0f3eb13a68520284be
Jul 07 02:43:47.836861 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:47.836764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" event={"ID":"0bc44c3c-d5a6-4b9c-b746-cc300be867e4","Type":"ContainerStarted","Data":"798d72ee2e9160302486386468277e9ec17919874f871c0f3eb13a68520284be"}
Jul 07 02:43:48.844413 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:48.844371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" event={"ID":"0bc44c3c-d5a6-4b9c-b746-cc300be867e4","Type":"ContainerStarted","Data":"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"}
Jul 07 02:43:48.844920 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:48.844568    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:48.863577 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:48.863519    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" podStartSLOduration=2.454270356 podStartE2EDuration="2.863502217s" totalImagesPullingTime="409.231861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:43:48.862034916 +0000 UTC m=+1742.260033248" watchObservedRunningTime="2026-07-07 02:43:48.863502217 +0000 UTC m=+1742.261500549"
Jul 07 02:43:51.975652 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:51.975593    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:51.976071 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:51.975931    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" podUID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" containerName="maas-api" containerID="cri-o://3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9" gracePeriod=30
Jul 07 02:43:52.224364 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.224336    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:52.276070 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.276039    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-758db\" (UniqueName: \"kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db\") pod \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") "
Jul 07 02:43:52.276285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.276086    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") pod \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") "
Jul 07 02:43:52.276285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.276133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca\") pod \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\" (UID: \"0bc44c3c-d5a6-4b9c-b746-cc300be867e4\") "
Jul 07 02:43:52.276637 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.276572    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0bc44c3c-d5a6-4b9c-b746-cc300be867e4" (UID: "0bc44c3c-d5a6-4b9c-b746-cc300be867e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:43:52.278430 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.278401    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db" (OuterVolumeSpecName: "kube-api-access-758db") pod "0bc44c3c-d5a6-4b9c-b746-cc300be867e4" (UID: "0bc44c3c-d5a6-4b9c-b746-cc300be867e4"). InnerVolumeSpecName "kube-api-access-758db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:43:52.278532 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.278477    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0bc44c3c-d5a6-4b9c-b746-cc300be867e4" (UID: "0bc44c3c-d5a6-4b9c-b746-cc300be867e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:43:52.377593 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.377545    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-758db\" (UniqueName: \"kubernetes.io/projected/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-kube-api-access-758db\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:52.377797 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.377628    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:52.377797 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.377645    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc44c3c-d5a6-4b9c-b746-cc300be867e4-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:43:52.871594 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.871554    2559 generic.go:356] "Generic (PLEG): container finished" podID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" containerID="3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9" exitCode=0
Jul 07 02:43:52.871804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.871600    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"
Jul 07 02:43:52.871804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.871646    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" event={"ID":"0bc44c3c-d5a6-4b9c-b746-cc300be867e4","Type":"ContainerDied","Data":"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"}
Jul 07 02:43:52.871804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.871709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf" event={"ID":"0bc44c3c-d5a6-4b9c-b746-cc300be867e4","Type":"ContainerDied","Data":"798d72ee2e9160302486386468277e9ec17919874f871c0f3eb13a68520284be"}
Jul 07 02:43:52.871804 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.871750    2559 scope.go:117] "RemoveContainer" containerID="3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"
Jul 07 02:43:52.881037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.881018    2559 scope.go:117] "RemoveContainer" containerID="3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"
Jul 07 02:43:52.881353 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:43:52.881332    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9\": container with ID starting with 3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9 not found: ID does not exist" containerID="3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"
Jul 07 02:43:52.881427 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.881361    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9"} err="failed to get container status \"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9\": rpc error: code = NotFound desc = could not find container \"3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9\": container with ID starting with 3ccbc589d5b47454e872b0bda7885a515a13fae88e5dde1d6a9eb51fc46393b9 not found: ID does not exist"
Jul 07 02:43:52.894001 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.893973    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:52.897846 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:52.897820    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f3a52fbf-774b6855b-gbmgf"]
Jul 07 02:43:53.155101 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:43:53.155020    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" path="/var/lib/kubelet/pods/0bc44c3c-d5a6-4b9c-b746-cc300be867e4/volumes"
Jul 07 02:44:03.706285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.706250    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:03.706863 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.706794    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" containerName="maas-api"
Jul 07 02:44:03.706863 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.706817    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" containerName="maas-api"
Jul 07 02:44:03.706981 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.706915    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc44c3c-d5a6-4b9c-b746-cc300be867e4" containerName="maas-api"
Jul 07 02:44:03.711449 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.711426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.714594 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.714567    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-91525fbf-openshift-default-dockercfg-5kc6l\""
Jul 07 02:44:03.722373 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.722342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:03.773531 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773726 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfqnx\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773895 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773895 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773895 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.773895 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.773805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874536 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874536 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfqnx\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874536 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874642    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.874764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.875042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874805    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.875042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.874949    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.875042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.875015    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.875366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.875345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.877028 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.877008    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.877273 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.877256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.883263 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.883230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:03.883378 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:03.883353    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfqnx\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx\") pod \"e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") " pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:04.024802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.024762    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:04.169896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.169858    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:04.171945 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:44:04.171918    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8cd9f0_aa1f_43be_9db8_16a87dd5d39d.slice/crio-f06a6a79e2f5bec1c5b9e3cf13d087e09279c424ef77fdacced3cf045eea13e8 WatchSource:0}: Error finding container f06a6a79e2f5bec1c5b9e3cf13d087e09279c424ef77fdacced3cf045eea13e8: Status 404 returned error can't find the container with id f06a6a79e2f5bec1c5b9e3cf13d087e09279c424ef77fdacced3cf045eea13e8
Jul 07 02:44:04.174461 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.174427    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:44:04.174548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.174495    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:44:04.174548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.174537    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:44:04.937045 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.936997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" event={"ID":"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d","Type":"ContainerStarted","Data":"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"}
Jul 07 02:44:04.937457 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.937059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" event={"ID":"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d","Type":"ContainerStarted","Data":"f06a6a79e2f5bec1c5b9e3cf13d087e09279c424ef77fdacced3cf045eea13e8"}
Jul 07 02:44:04.965527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.965418    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" podStartSLOduration=1.965396584 podStartE2EDuration="1.965396584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:44:04.962798246 +0000 UTC m=+1758.360796579" watchObservedRunningTime="2026-07-07 02:44:04.965396584 +0000 UTC m=+1758.363394917"
Jul 07 02:44:04.992399 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.992361    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:04.995985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.995960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:04.999521 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:04.999497    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-91525fbf-serving-cert\""
Jul 07 02:44:05.010203 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.010170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:05.025064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.025030    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:05.030801 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.030770    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:05.086435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.086391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.086435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.086431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qjk\" (UniqueName: \"kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.086802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.086454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.188013 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.187977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.188013 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.188012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qjk\" (UniqueName: \"kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.188286 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.188034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.188286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:44:05.188137    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-91525fbf-serving-cert: secret "maas-api-e2e-derive-91525fbf-serving-cert" not found
Jul 07 02:44:05.188286 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:44:05.188222    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls podName:bf2a09d1-4bcf-4a98-81a9-93967ebb29c3 nodeName:}" failed. No retries permitted until 2026-07-07 02:44:05.688205209 +0000 UTC m=+1759.086203519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls") pod "maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" (UID: "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3") : secret "maas-api-e2e-derive-91525fbf-serving-cert" not found
Jul 07 02:44:05.188622 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.188587    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.198449 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.198418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qjk\" (UniqueName: \"kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.692707 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.692673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.695291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.695265    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") pod \"maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") " pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.912723 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.912679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:05.941808 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.941771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:05.942969 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:05.942912    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:06.069826 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:06.069755    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:06.070316 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:44:06.070286    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2a09d1_4bcf_4a98_81a9_93967ebb29c3.slice/crio-63bda37acd2d13e7e203b1ad75f1f2cc13d72a1992da2f11cdff88db3521de5a WatchSource:0}: Error finding container 63bda37acd2d13e7e203b1ad75f1f2cc13d72a1992da2f11cdff88db3521de5a: Status 404 returned error can't find the container with id 63bda37acd2d13e7e203b1ad75f1f2cc13d72a1992da2f11cdff88db3521de5a
Jul 07 02:44:06.948124 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:06.948086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" event={"ID":"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3","Type":"ContainerStarted","Data":"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"}
Jul 07 02:44:06.948505 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:06.948138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" event={"ID":"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3","Type":"ContainerStarted","Data":"63bda37acd2d13e7e203b1ad75f1f2cc13d72a1992da2f11cdff88db3521de5a"}
Jul 07 02:44:06.968504 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:06.968456    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" podStartSLOduration=2.636924237 podStartE2EDuration="2.968442652s" totalImagesPullingTime="331.518415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:44:06.966886519 +0000 UTC m=+1760.364884850" watchObservedRunningTime="2026-07-07 02:44:06.968442652 +0000 UTC m=+1760.366440983"
Jul 07 02:44:07.953904 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:07.953876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:09.626622 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:09.626575    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:09.627204 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:09.626868    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" podUID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" containerName="istio-proxy" containerID="cri-o://1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7" gracePeriod=30
Jul 07 02:44:09.871896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:09.871829    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:09.965842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:09.965717    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" podUID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" containerName="maas-api" containerID="cri-o://e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632" gracePeriod=30
Jul 07 02:44:10.268842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.268815    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:10.362460 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.362362    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24qjk\" (UniqueName: \"kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk\") pod \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") "
Jul 07 02:44:10.362675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.362517    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") pod \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") "
Jul 07 02:44:10.362675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.362546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca\") pod \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\" (UID: \"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3\") "
Jul 07 02:44:10.363101 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.363058    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" (UID: "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:44:10.364842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.364680    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk" (OuterVolumeSpecName: "kube-api-access-24qjk") pod "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" (UID: "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3"). InnerVolumeSpecName "kube-api-access-24qjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:44:10.364942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.364908    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" (UID: "bf2a09d1-4bcf-4a98-81a9-93967ebb29c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:44:10.464191 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.464145    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24qjk\" (UniqueName: \"kubernetes.io/projected/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-kube-api-access-24qjk\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:10.464191 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.464186    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:10.464191 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.464195    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:10.971668 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.971601    2559 generic.go:356] "Generic (PLEG): container finished" podID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" containerID="e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632" exitCode=0
Jul 07 02:44:10.972110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.971676    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"
Jul 07 02:44:10.972110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.971716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" event={"ID":"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3","Type":"ContainerDied","Data":"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"}
Jul 07 02:44:10.972110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.971781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx" event={"ID":"bf2a09d1-4bcf-4a98-81a9-93967ebb29c3","Type":"ContainerDied","Data":"63bda37acd2d13e7e203b1ad75f1f2cc13d72a1992da2f11cdff88db3521de5a"}
Jul 07 02:44:10.972110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.971814    2559 scope.go:117] "RemoveContainer" containerID="e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"
Jul 07 02:44:10.982150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.982131    2559 scope.go:117] "RemoveContainer" containerID="e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"
Jul 07 02:44:10.982412 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:44:10.982390    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632\": container with ID starting with e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632 not found: ID does not exist" containerID="e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"
Jul 07 02:44:10.982476 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.982421    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632"} err="failed to get container status \"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632\": rpc error: code = NotFound desc = could not find container \"e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632\": container with ID starting with e3a18e44cd25632552293b16b3852d9e673959f6e118570c6c69f936ae975632 not found: ID does not exist"
Jul 07 02:44:10.994381 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.994356    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:10.999561 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:10.999532    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-91525fbf-687b69f5dd-ffvkx"]
Jul 07 02:44:11.159763 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:11.159725    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" path="/var/lib/kubelet/pods/bf2a09d1-4bcf-4a98-81a9-93967ebb29c3/volumes"
Jul 07 02:44:15.391270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.391248    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:15.408121 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408088    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408129    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408148    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408266 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408269    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfqnx\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx\") pod \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\" (UID: \"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d\") "
Jul 07 02:44:15.408527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408389    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:15.408788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408653    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.408788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408654    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:15.408788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408669    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:15.408788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.408705    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:44:15.409368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.409348    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:15.410414 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.410390    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:44:15.410740 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.410723    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx" (OuterVolumeSpecName: "kube-api-access-kfqnx") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "kube-api-access-kfqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:44:15.410931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.410912    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:44:15.410931 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.410900    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" (UID: "aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:44:15.510081 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510049    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510081 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510078    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510092    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510107    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfqnx\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-kube-api-access-kfqnx\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510118    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510126    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510134    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:15.510290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:15.510141    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:44:16.005209 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.005175    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" containerID="1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7" exitCode=0
Jul 07 02:44:16.005402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.005236    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"
Jul 07 02:44:16.005402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.005264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" event={"ID":"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d","Type":"ContainerDied","Data":"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"}
Jul 07 02:44:16.005402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.005352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4" event={"ID":"aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d","Type":"ContainerDied","Data":"f06a6a79e2f5bec1c5b9e3cf13d087e09279c424ef77fdacced3cf045eea13e8"}
Jul 07 02:44:16.005402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.005381    2559 scope.go:117] "RemoveContainer" containerID="1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"
Jul 07 02:44:16.015044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.015025    2559 scope.go:117] "RemoveContainer" containerID="1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"
Jul 07 02:44:16.015359 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:44:16.015332    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7\": container with ID starting with 1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7 not found: ID does not exist" containerID="1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"
Jul 07 02:44:16.015432 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.015372    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7"} err="failed to get container status \"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7\": rpc error: code = NotFound desc = could not find container \"1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7\": container with ID starting with 1064672a5cf8cb935d125046942726e8fac715da6eb26521f6a7925228cac0c7 not found: ID does not exist"
Jul 07 02:44:16.034902 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.034858    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:16.049098 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:16.049064    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-91525fbf-openshift-default-74d75c485f-jwkv4"]
Jul 07 02:44:17.156198 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:44:17.156161    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" path="/var/lib/kubelet/pods/aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d/volumes"
Jul 07 02:45:00.136852 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.136810    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-555jw"]
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137179    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" containerName="istio-proxy"
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137192    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" containerName="istio-proxy"
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137200    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" containerName="maas-api"
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137206    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" containerName="maas-api"
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137256    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa8cd9f0-aa1f-43be-9db8-16a87dd5d39d" containerName="istio-proxy"
Jul 07 02:45:00.137302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.137265    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf2a09d1-4bcf-4a98-81a9-93967ebb29c3" containerName="maas-api"
Jul 07 02:45:00.141381 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.141360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:00.148223 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.147910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-555jw"]
Jul 07 02:45:00.210573 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.210539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgn9h\" (UniqueName: \"kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h\") pod \"maas-api-key-cleanup-29723205-555jw\" (UID: \"012a7938-124e-4180-94de-989c9fd46bc2\") " pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:00.311251 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.311210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgn9h\" (UniqueName: \"kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h\") pod \"maas-api-key-cleanup-29723205-555jw\" (UID: \"012a7938-124e-4180-94de-989c9fd46bc2\") " pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:00.322047 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.322021    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgn9h\" (UniqueName: \"kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h\") pod \"maas-api-key-cleanup-29723205-555jw\" (UID: \"012a7938-124e-4180-94de-989c9fd46bc2\") " pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:00.453951 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.453855    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:00.593474 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:00.593281    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723205-555jw"]
Jul 07 02:45:00.596491 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:45:00.596460    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012a7938_124e_4180_94de_989c9fd46bc2.slice/crio-4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a WatchSource:0}: Error finding container 4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a: Status 404 returned error can't find the container with id 4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a
Jul 07 02:45:01.220984 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:01.220888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-555jw" event={"ID":"012a7938-124e-4180-94de-989c9fd46bc2","Type":"ContainerStarted","Data":"93ae0c90276062251d6a5473e680ee0a51c91dba1e9755c2a941d450e5f246cd"}
Jul 07 02:45:01.220984 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:01.220946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-555jw" event={"ID":"012a7938-124e-4180-94de-989c9fd46bc2","Type":"ContainerStarted","Data":"4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a"}
Jul 07 02:45:01.237774 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:01.237725    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723205-555jw" podStartSLOduration=1.237708047 podStartE2EDuration="1.237708047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:45:01.236655935 +0000 UTC m=+1814.634654268" watchObservedRunningTime="2026-07-07 02:45:01.237708047 +0000 UTC m=+1814.635706416"
Jul 07 02:45:02.227287 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:02.227247    2559 generic.go:356] "Generic (PLEG): container finished" podID="012a7938-124e-4180-94de-989c9fd46bc2" containerID="93ae0c90276062251d6a5473e680ee0a51c91dba1e9755c2a941d450e5f246cd" exitCode=0
Jul 07 02:45:02.227287 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:02.227291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-555jw" event={"ID":"012a7938-124e-4180-94de-989c9fd46bc2","Type":"ContainerDied","Data":"93ae0c90276062251d6a5473e680ee0a51c91dba1e9755c2a941d450e5f246cd"}
Jul 07 02:45:03.366730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:03.366700    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:03.531719 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:03.531597    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgn9h\" (UniqueName: \"kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h\") pod \"012a7938-124e-4180-94de-989c9fd46bc2\" (UID: \"012a7938-124e-4180-94de-989c9fd46bc2\") "
Jul 07 02:45:03.533874 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:03.533852    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h" (OuterVolumeSpecName: "kube-api-access-tgn9h") pod "012a7938-124e-4180-94de-989c9fd46bc2" (UID: "012a7938-124e-4180-94de-989c9fd46bc2"). InnerVolumeSpecName "kube-api-access-tgn9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:45:03.633037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:03.633000    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgn9h\" (UniqueName: \"kubernetes.io/projected/012a7938-124e-4180-94de-989c9fd46bc2-kube-api-access-tgn9h\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:45:04.238067 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:04.238029    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723205-555jw"
Jul 07 02:45:04.238272 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:04.238075    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723205-555jw" event={"ID":"012a7938-124e-4180-94de-989c9fd46bc2","Type":"ContainerDied","Data":"4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a"}
Jul 07 02:45:04.238272 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:04.238121    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4de4f06f9f137b315906d6c2765ae7e9c4156a57a621d9723ebc2ef73e0f572a"
Jul 07 02:45:51.355714 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.355678    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:45:51.356171 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.356057    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="012a7938-124e-4180-94de-989c9fd46bc2" containerName="cleanup"
Jul 07 02:45:51.356171 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.356071    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="012a7938-124e-4180-94de-989c9fd46bc2" containerName="cleanup"
Jul 07 02:45:51.356171 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.356145    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="012a7938-124e-4180-94de-989c9fd46bc2" containerName="cleanup"
Jul 07 02:45:51.359125 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.359106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.362730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.362707    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-132a2450-openshift-default-dockercfg-fs74q\""
Jul 07 02:45:51.376277 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.376245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:45:51.454252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55m7q\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.454503 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.454444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555537    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55m7q\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.555751 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.556229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.555981    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.556229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.556018    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.556229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.556040    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.556229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.556107    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.556598 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.556576    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.558181 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.558157    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.558299 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.558281    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.565845 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.565822    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.566055 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.566032    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55m7q\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q\") pod \"e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") " pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.669369 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.669273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:51.812919 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.812886    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:45:51.818035 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:45:51.818002    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f12adfb_50cc_42a8_b1e8_2888acb32e1b.slice/crio-417260b4b0b7ca04139537be0367b82f28767ae23944d12596722e23d257667a WatchSource:0}: Error finding container 417260b4b0b7ca04139537be0367b82f28767ae23944d12596722e23d257667a: Status 404 returned error can't find the container with id 417260b4b0b7ca04139537be0367b82f28767ae23944d12596722e23d257667a
Jul 07 02:45:51.820480 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.820444    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:45:51.820548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.820510    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:45:51.820548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:51.820543    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:45:52.482769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:52.482730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerStarted","Data":"58102c83f252302d3e63c335e6c42af52cb381a7b4ef8d14ab690363ef0039a1"}
Jul 07 02:45:52.483260 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:52.482810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerStarted","Data":"417260b4b0b7ca04139537be0367b82f28767ae23944d12596722e23d257667a"}
Jul 07 02:45:52.505569 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:52.505518    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podStartSLOduration=1.505503129 podStartE2EDuration="1.505503129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:45:52.503266666 +0000 UTC m=+1865.901265000" watchObservedRunningTime="2026-07-07 02:45:52.505503129 +0000 UTC m=+1865.903501461"
Jul 07 02:45:52.670308 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:52.670274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:52.675259 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:52.675228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:53.488227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:53.488190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:53.489164 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:53.489142    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:45:54.476058 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.476011    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:45:54.480255 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.480234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.483152 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.483117    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-132a2450-serving-cert\""
Jul 07 02:45:54.487496 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.487467    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:45:54.584547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.584509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.584547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.584554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrk5\" (UniqueName: \"kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.585037 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.584582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.686211 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.686171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.686211 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.686217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrk5\" (UniqueName: \"kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.686426 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.686243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.686426 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:45:54.686327    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-132a2450-serving-cert: secret "maas-api-e2e-mt-132a2450-serving-cert" not found
Jul 07 02:45:54.686426 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:45:54.686395    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls podName:0670488b-e688-4ba6-80f7-31611788e570 nodeName:}" failed. No retries permitted until 2026-07-07 02:45:55.186377759 +0000 UTC m=+1868.584376073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls") pod "maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" (UID: "0670488b-e688-4ba6-80f7-31611788e570") : secret "maas-api-e2e-mt-132a2450-serving-cert" not found
Jul 07 02:45:54.686995 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.686975    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:54.695413 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:54.695383    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrk5\" (UniqueName: \"kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:55.191366 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:55.191327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:55.194147 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:55.194113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") pod \"maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") " pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:55.394497 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:55.394460    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:55.541473 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:55.541442    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:45:55.543106 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:45:55.543073    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0670488b_e688_4ba6_80f7_31611788e570.slice/crio-e2d6838c86eedfb3b15f2e8dc44385b95fbdbc57c496aa48d2780649d8184c23 WatchSource:0}: Error finding container e2d6838c86eedfb3b15f2e8dc44385b95fbdbc57c496aa48d2780649d8184c23: Status 404 returned error can't find the container with id e2d6838c86eedfb3b15f2e8dc44385b95fbdbc57c496aa48d2780649d8184c23
Jul 07 02:45:56.506929 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:56.506893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" event={"ID":"0670488b-e688-4ba6-80f7-31611788e570","Type":"ContainerStarted","Data":"4c2324dcdd02461b13016d4b64872d82e41813513eed3f3f5b318f1c583acecc"}
Jul 07 02:45:56.507379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:56.506972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" event={"ID":"0670488b-e688-4ba6-80f7-31611788e570","Type":"ContainerStarted","Data":"e2d6838c86eedfb3b15f2e8dc44385b95fbdbc57c496aa48d2780649d8184c23"}
Jul 07 02:45:56.507379 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:56.507107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:45:56.525241 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:45:56.525191    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" podStartSLOduration=2.128860937 podStartE2EDuration="2.525175254s" totalImagesPullingTime="396.314317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:45:56.523793936 +0000 UTC m=+1869.921792269" watchObservedRunningTime="2026-07-07 02:45:56.525175254 +0000 UTC m=+1869.923173588"
Jul 07 02:46:02.517115 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:02.517083    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:46:06.442899 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.442856    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:46:06.443377 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.443156    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" podUID="0670488b-e688-4ba6-80f7-31611788e570" containerName="maas-api" containerID="cri-o://4c2324dcdd02461b13016d4b64872d82e41813513eed3f3f5b318f1c583acecc" gracePeriod=30
Jul 07 02:46:06.576889 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.576856    2559 generic.go:356] "Generic (PLEG): container finished" podID="0670488b-e688-4ba6-80f7-31611788e570" containerID="4c2324dcdd02461b13016d4b64872d82e41813513eed3f3f5b318f1c583acecc" exitCode=0
Jul 07 02:46:06.577056 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.576938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" event={"ID":"0670488b-e688-4ba6-80f7-31611788e570","Type":"ContainerDied","Data":"4c2324dcdd02461b13016d4b64872d82e41813513eed3f3f5b318f1c583acecc"}
Jul 07 02:46:06.714419 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.714354    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:46:06.799108 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.799073    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqrk5\" (UniqueName: \"kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5\") pod \"0670488b-e688-4ba6-80f7-31611788e570\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") "
Jul 07 02:46:06.800715 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.799130    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca\") pod \"0670488b-e688-4ba6-80f7-31611788e570\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") "
Jul 07 02:46:06.800715 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.799253    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") pod \"0670488b-e688-4ba6-80f7-31611788e570\" (UID: \"0670488b-e688-4ba6-80f7-31611788e570\") "
Jul 07 02:46:06.800715 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.799430    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0670488b-e688-4ba6-80f7-31611788e570" (UID: "0670488b-e688-4ba6-80f7-31611788e570"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:46:06.801451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.801420    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5" (OuterVolumeSpecName: "kube-api-access-xqrk5") pod "0670488b-e688-4ba6-80f7-31611788e570" (UID: "0670488b-e688-4ba6-80f7-31611788e570"). InnerVolumeSpecName "kube-api-access-xqrk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:46:06.801587 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.801468    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0670488b-e688-4ba6-80f7-31611788e570" (UID: "0670488b-e688-4ba6-80f7-31611788e570"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:46:06.900132 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.900096    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0670488b-e688-4ba6-80f7-31611788e570-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:06.900132 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.900129    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqrk5\" (UniqueName: \"kubernetes.io/projected/0670488b-e688-4ba6-80f7-31611788e570-kube-api-access-xqrk5\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:06.900132 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:06.900139    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0670488b-e688-4ba6-80f7-31611788e570-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:07.583406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.583372    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"
Jul 07 02:46:07.583885 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.583377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz" event={"ID":"0670488b-e688-4ba6-80f7-31611788e570","Type":"ContainerDied","Data":"e2d6838c86eedfb3b15f2e8dc44385b95fbdbc57c496aa48d2780649d8184c23"}
Jul 07 02:46:07.583885 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.583523    2559 scope.go:117] "RemoveContainer" containerID="4c2324dcdd02461b13016d4b64872d82e41813513eed3f3f5b318f1c583acecc"
Jul 07 02:46:07.585336 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.585306    2559 generic.go:356] "Generic (PLEG): container finished" podID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerID="58102c83f252302d3e63c335e6c42af52cb381a7b4ef8d14ab690363ef0039a1" exitCode=0
Jul 07 02:46:07.585440 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.585332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerDied","Data":"58102c83f252302d3e63c335e6c42af52cb381a7b4ef8d14ab690363ef0039a1"}
Jul 07 02:46:07.585860 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.585840    2559 scope.go:117] "RemoveContainer" containerID="58102c83f252302d3e63c335e6c42af52cb381a7b4ef8d14ab690363ef0039a1"
Jul 07 02:46:07.586887 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.586854    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:07.586988 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.586937    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:07.587053 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.587008    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:07.602029 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.602002    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:46:07.605291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:07.605265    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-132a2450-5dd67cdc78-kjwjz"]
Jul 07 02:46:08.489123 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:08.489088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:46:08.592661 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:08.592616    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerStarted","Data":"71262eaa7be085f09e9a1c7ed26ab9761064875c5188170eb6d6d6c7478a2d06"}
Jul 07 02:46:08.670385 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:08.670339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:46:08.671440 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:08.671413    2559 patch_prober.go:28] interesting pod/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 07 02:46:08.671573 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:08.671462    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 07 02:46:09.163402 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:09.163359    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0670488b-e688-4ba6-80f7-31611788e570" path="/var/lib/kubelet/pods/0670488b-e688-4ba6-80f7-31611788e570/volumes"
Jul 07 02:46:09.670533 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:09.670490    2559 patch_prober.go:28] interesting pod/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 07 02:46:09.670959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:09.670592    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 07 02:46:10.670748 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:10.670701    2559 patch_prober.go:28] interesting pod/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 07 02:46:10.671155 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:10.670766    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 07 02:46:11.670321 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:11.670279    2559 patch_prober.go:28] interesting pod/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 07 02:46:11.670501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:11.670341    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 07 02:46:12.428924 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:12.428882    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:46:12.429401 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:12.429120    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy" containerID="cri-o://71262eaa7be085f09e9a1c7ed26ab9761064875c5188170eb6d6d6c7478a2d06" gracePeriod=30
Jul 07 02:46:17.640495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.640452    2559 generic.go:356] "Generic (PLEG): container finished" podID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerID="71262eaa7be085f09e9a1c7ed26ab9761064875c5188170eb6d6d6c7478a2d06" exitCode=0
Jul 07 02:46:17.640950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.640526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerDied","Data":"71262eaa7be085f09e9a1c7ed26ab9761064875c5188170eb6d6d6c7478a2d06"}
Jul 07 02:46:17.640950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.640626    2559 scope.go:117] "RemoveContainer" containerID="58102c83f252302d3e63c335e6c42af52cb381a7b4ef8d14ab690363ef0039a1"
Jul 07 02:46:17.696841 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.696765    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:46:17.797873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.797873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797970    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.797988    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798034    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798137 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798321    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:46:17.798451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798311    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:46:17.798451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798384    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55m7q\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q\") pod \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\" (UID: \"7f12adfb-50cc-42a8-b1e8-2888acb32e1b\") "
Jul 07 02:46:17.798451 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798414    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:46:17.798663 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798634    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:46:17.798907 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798887    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:46:17.798973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798913    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.798973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798934    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.798973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798947    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.798973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.798960    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.800321 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.800300    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:46:17.800410 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.800336    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:46:17.801243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.801220    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q" (OuterVolumeSpecName: "kube-api-access-55m7q") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "kube-api-access-55m7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:46:17.801243 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.801221    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f12adfb-50cc-42a8-b1e8-2888acb32e1b" (UID: "7f12adfb-50cc-42a8-b1e8-2888acb32e1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:46:17.899508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.899465    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.899508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.899501    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55m7q\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-kube-api-access-55m7q\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.899508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.899511    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.899508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.899520    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:17.899815 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:17.899528    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f12adfb-50cc-42a8-b1e8-2888acb32e1b-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:46:18.646048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:18.646013    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"
Jul 07 02:46:18.646048 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:18.646040    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq" event={"ID":"7f12adfb-50cc-42a8-b1e8-2888acb32e1b","Type":"ContainerDied","Data":"417260b4b0b7ca04139537be0367b82f28767ae23944d12596722e23d257667a"}
Jul 07 02:46:18.646514 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:18.646099    2559 scope.go:117] "RemoveContainer" containerID="71262eaa7be085f09e9a1c7ed26ab9761064875c5188170eb6d6d6c7478a2d06"
Jul 07 02:46:18.669386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:18.669351    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:46:18.672893 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:18.672866    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-132a2450-openshift-default-68df6ccbb7-6lsjq"]
Jul 07 02:46:19.154486 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:19.154454    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" path="/var/lib/kubelet/pods/7f12adfb-50cc-42a8-b1e8-2888acb32e1b/volumes"
Jul 07 02:46:31.829411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.829372    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:46:31.829944 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.829927    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.829992 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.829947    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.829992 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.829963    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0670488b-e688-4ba6-80f7-31611788e570" containerName="maas-api"
Jul 07 02:46:31.829992 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.829973    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0670488b-e688-4ba6-80f7-31611788e570" containerName="maas-api"
Jul 07 02:46:31.830088 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.830006    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.830088 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.830016    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.830154 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.830105    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0670488b-e688-4ba6-80f7-31611788e570" containerName="maas-api"
Jul 07 02:46:31.830154 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.830118    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.830154 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.830129    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f12adfb-50cc-42a8-b1e8-2888acb32e1b" containerName="istio-proxy"
Jul 07 02:46:31.835128 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.835102    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.838273 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.838249    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d71dd72e-openshift-default-dockercfg-fr5h2\""
Jul 07 02:46:31.846327 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.846301    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:46:31.929873 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.929835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930059 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.929884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930059 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930059 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmnv\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:31.930221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:31.930176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.030961 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.030921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.030984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmnv\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031143 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031312 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031312 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031312 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031474 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031485    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031679 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031650    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031808 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031717    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.031808 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.031742    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.032041 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.032018    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.034123 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.034098    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.034323 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.034306    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.039674 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.039653    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.039774 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.039758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmnv\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv\") pod \"e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") " pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.147221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.147127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:32.297805 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.297779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:46:32.299983 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:46:32.299954    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7b85c0_49f3_4ae2_b251_c266fd6d22e8.slice/crio-3f48be66d8152b203bebb80ba8fb4ed32a1d9a1731dbe2d42afd06410b09f739 WatchSource:0}: Error finding container 3f48be66d8152b203bebb80ba8fb4ed32a1d9a1731dbe2d42afd06410b09f739: Status 404 returned error can't find the container with id 3f48be66d8152b203bebb80ba8fb4ed32a1d9a1731dbe2d42afd06410b09f739
Jul 07 02:46:32.302777 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.302733    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:32.302865 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.302830    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:32.302927 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.302875    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:32.714352 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.714316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerStarted","Data":"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"}
Jul 07 02:46:32.714508 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.714372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerStarted","Data":"3f48be66d8152b203bebb80ba8fb4ed32a1d9a1731dbe2d42afd06410b09f739"}
Jul 07 02:46:32.735003 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:32.734949    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podStartSLOduration=1.7349326120000002 podStartE2EDuration="1.734932612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:46:32.73280554 +0000 UTC m=+1906.130803873" watchObservedRunningTime="2026-07-07 02:46:32.734932612 +0000 UTC m=+1906.132930943"
Jul 07 02:46:33.147292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:33.147254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:33.154439 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:33.154408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:33.719345 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:33.719314    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:33.720334 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:33.720309    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:34.779823 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.779778    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:46:34.787770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.784959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:34.788762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.788258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-d71dd72e-serving-cert\""
Jul 07 02:46:34.794051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.794022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:46:34.960003 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.959959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:34.960003 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.960008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:34.960238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:34.960033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdkv\" (UniqueName: \"kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.060898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.060804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.060898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.060859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.060898 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.060888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdkv\" (UniqueName: \"kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.061578 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.061557    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.063659 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.063634    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.074777 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.074745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdkv\" (UniqueName: \"kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv\") pod \"maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") " pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.102743 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.102705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.243377 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.243347    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:46:35.245426 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:46:35.245397    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a33435e_0f86_4db8_857d_b4b9572c2f15.slice/crio-360d6d17d5f044571fd0abef45472bfc10f215fdb21d6710d59629c5d4bf6448 WatchSource:0}: Error finding container 360d6d17d5f044571fd0abef45472bfc10f215fdb21d6710d59629c5d4bf6448: Status 404 returned error can't find the container with id 360d6d17d5f044571fd0abef45472bfc10f215fdb21d6710d59629c5d4bf6448
Jul 07 02:46:35.734257 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.734219    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" event={"ID":"9a33435e-0f86-4db8-857d-b4b9572c2f15","Type":"ContainerStarted","Data":"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"}
Jul 07 02:46:35.734511 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.734284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" event={"ID":"9a33435e-0f86-4db8-857d-b4b9572c2f15","Type":"ContainerStarted","Data":"360d6d17d5f044571fd0abef45472bfc10f215fdb21d6710d59629c5d4bf6448"}
Jul 07 02:46:35.734511 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.734318    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:35.753171 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:35.753111    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" podStartSLOduration=1.4037843429999999 podStartE2EDuration="1.753093832s" totalImagesPullingTime="349.309489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:46:35.751484062 +0000 UTC m=+1909.149482394" watchObservedRunningTime="2026-07-07 02:46:35.753093832 +0000 UTC m=+1909.151092163"
Jul 07 02:46:41.759834 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:41.759792    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:46:48.720978 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.720889    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 02:46:48.720978 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.720948    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 02:46:48.803452 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.803407    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerID="287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470" exitCode=0
Jul 07 02:46:48.803649 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.803475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerDied","Data":"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"}
Jul 07 02:46:48.803929 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.803914    2559 scope.go:117] "RemoveContainer" containerID="287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"
Jul 07 02:46:48.804936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.804903    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:48.805042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.804976    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:48.805042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:48.805012    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:46:49.816358 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:49.816322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerStarted","Data":"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"}
Jul 07 02:46:50.148151 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:50.148048    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:50.149168 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:50.148425    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 02:46:50.149390 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:50.149366    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 02:46:51.147468 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:51.147430    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 02:46:51.151695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:51.151654    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 02:46:52.148575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:52.148523    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 02:46:52.149110 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:52.148640    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 02:46:53.149648 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:53.149166    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 02:46:53.149648 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:53.149233    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 02:46:54.150973 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:54.150940    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:54.151363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:54.151307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:46:54.151942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:46:54.151925    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:47:07.197762 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.197725    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:47:07.198212 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.198014    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" podUID="9a33435e-0f86-4db8-857d-b4b9572c2f15" containerName="maas-api" containerID="cri-o://e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532" gracePeriod=30
Jul 07 02:47:07.454351 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.454285    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:47:07.541562 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.541530    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca\") pod \"9a33435e-0f86-4db8-857d-b4b9572c2f15\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") "
Jul 07 02:47:07.541562 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.541570    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwdkv\" (UniqueName: \"kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv\") pod \"9a33435e-0f86-4db8-857d-b4b9572c2f15\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") "
Jul 07 02:47:07.541851 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.541631    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls\") pod \"9a33435e-0f86-4db8-857d-b4b9572c2f15\" (UID: \"9a33435e-0f86-4db8-857d-b4b9572c2f15\") "
Jul 07 02:47:07.542018 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.541994    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a33435e-0f86-4db8-857d-b4b9572c2f15" (UID: "9a33435e-0f86-4db8-857d-b4b9572c2f15"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:47:07.543893 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.543859    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv" (OuterVolumeSpecName: "kube-api-access-wwdkv") pod "9a33435e-0f86-4db8-857d-b4b9572c2f15" (UID: "9a33435e-0f86-4db8-857d-b4b9572c2f15"). InnerVolumeSpecName "kube-api-access-wwdkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:47:07.544012 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.543932    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a33435e-0f86-4db8-857d-b4b9572c2f15" (UID: "9a33435e-0f86-4db8-857d-b4b9572c2f15"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:47:07.643210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.643171    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwdkv\" (UniqueName: \"kubernetes.io/projected/9a33435e-0f86-4db8-857d-b4b9572c2f15-kube-api-access-wwdkv\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:47:07.643210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.643204    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a33435e-0f86-4db8-857d-b4b9572c2f15-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:47:07.643210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.643213    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a33435e-0f86-4db8-857d-b4b9572c2f15-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:47:07.911778 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.911741    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a33435e-0f86-4db8-857d-b4b9572c2f15" containerID="e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532" exitCode=0
Jul 07 02:47:07.911985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.911797    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"
Jul 07 02:47:07.911985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.911826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" event={"ID":"9a33435e-0f86-4db8-857d-b4b9572c2f15","Type":"ContainerDied","Data":"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"}
Jul 07 02:47:07.911985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.911882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh" event={"ID":"9a33435e-0f86-4db8-857d-b4b9572c2f15","Type":"ContainerDied","Data":"360d6d17d5f044571fd0abef45472bfc10f215fdb21d6710d59629c5d4bf6448"}
Jul 07 02:47:07.911985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.911906    2559 scope.go:117] "RemoveContainer" containerID="e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"
Jul 07 02:47:07.921809 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.921785    2559 scope.go:117] "RemoveContainer" containerID="e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"
Jul 07 02:47:07.922122 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:47:07.922106    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532\": container with ID starting with e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532 not found: ID does not exist" containerID="e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"
Jul 07 02:47:07.922170 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.922131    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532"} err="failed to get container status \"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532\": rpc error: code = NotFound desc = could not find container \"e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532\": container with ID starting with e04478967f7a2695203526b7975dfeb0936a4d44e8fa259b4f9d46a481941532 not found: ID does not exist"
Jul 07 02:47:07.934552 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.934522    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:47:07.938467 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:07.938442    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-d71dd72e-7bc869bc64-smrsh"]
Jul 07 02:47:09.156696 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:47:09.156656    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a33435e-0f86-4db8-857d-b4b9572c2f15" path="/var/lib/kubelet/pods/9a33435e-0f86-4db8-857d-b4b9572c2f15/volumes"
Jul 07 02:48:05.736332 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:05.736284    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:48:05.736880 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:05.736510    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" containerID="cri-o://5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be" gracePeriod=30
Jul 07 02:48:09.153799 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:09.153763    2559 patch_prober.go:28] interesting pod/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:48:09.154201 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:09.153838    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:48:11.003535 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.003462    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:48:11.097115 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097065    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097115 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097114    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097188    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097386 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097213    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097551 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097551 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097523    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097562    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmnv\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097656    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data\") pod \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\" (UID: \"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8\") "
Jul 07 02:48:11.097825 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.097796    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:48:11.098337 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.098278    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:48:11.098337 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.098299    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.098549 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.098364    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:48:11.098752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.098690    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:48:11.098941 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.098916    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:48:11.100131 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.100105    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:48:11.100222 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.100133    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:48:11.100222 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.100153    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:48:11.100344 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.100330    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv" (OuterVolumeSpecName: "kube-api-access-cqmnv") pod "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" (UID: "2a7b85c0-49f3-4ae2-b251-c266fd6d22e8"). InnerVolumeSpecName "kube-api-access-cqmnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:48:11.198828 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198799    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.198828 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198824    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmnv\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-kube-api-access-cqmnv\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.198828 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198835    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.199054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198843    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.199054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198851    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.199054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198859    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.199054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198866    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.199054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.198874    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:48:11.226547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.226516    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerID="5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be" exitCode=0
Jul 07 02:48:11.226731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.226567    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"
Jul 07 02:48:11.226731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.226596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerDied","Data":"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"}
Jul 07 02:48:11.226731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.226675    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk" event={"ID":"2a7b85c0-49f3-4ae2-b251-c266fd6d22e8","Type":"ContainerDied","Data":"3f48be66d8152b203bebb80ba8fb4ed32a1d9a1731dbe2d42afd06410b09f739"}
Jul 07 02:48:11.226731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.226706    2559 scope.go:117] "RemoveContainer" containerID="5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"
Jul 07 02:48:11.237450 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.237427    2559 scope.go:117] "RemoveContainer" containerID="287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"
Jul 07 02:48:11.245810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.245793    2559 scope.go:117] "RemoveContainer" containerID="5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"
Jul 07 02:48:11.246090 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:48:11.246070    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be\": container with ID starting with 5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be not found: ID does not exist" containerID="5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"
Jul 07 02:48:11.246146 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.246100    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be"} err="failed to get container status \"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be\": rpc error: code = NotFound desc = could not find container \"5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be\": container with ID starting with 5eb52a125ce22f913dc396198a4ec9f2bf3e39eadf544d0cd91cd893859882be not found: ID does not exist"
Jul 07 02:48:11.246146 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.246120    2559 scope.go:117] "RemoveContainer" containerID="287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"
Jul 07 02:48:11.246364 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:48:11.246345    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470\": container with ID starting with 287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470 not found: ID does not exist" containerID="287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"
Jul 07 02:48:11.246415 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.246373    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470"} err="failed to get container status \"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470\": rpc error: code = NotFound desc = could not find container \"287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470\": container with ID starting with 287d27d625596aeb04ed5201b99b03cb2cf708041ba212a9758006bc78fd5470 not found: ID does not exist"
Jul 07 02:48:11.251393 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.251367    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:48:11.255184 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:11.255132    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d71dd72e-openshift-default-fcfd6cf59-ckkrk"]
Jul 07 02:48:13.154985 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:13.154953    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" path="/var/lib/kubelet/pods/2a7b85c0-49f3-4ae2-b251-c266fd6d22e8/volumes"
Jul 07 02:48:59.784499 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.784462    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:48:59.785075 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785012    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:48:59.785075 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785033    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:48:59.785075 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785066    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a33435e-0f86-4db8-857d-b4b9572c2f15" containerName="maas-api"
Jul 07 02:48:59.785075 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785075    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a33435e-0f86-4db8-857d-b4b9572c2f15" containerName="maas-api"
Jul 07 02:48:59.785297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785167    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a33435e-0f86-4db8-857d-b4b9572c2f15" containerName="maas-api"
Jul 07 02:48:59.785297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785182    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:48:59.785297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.785191    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:48:59.788435 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.788404    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.791571 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.791547    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-606263-openshift-default-dockercfg-f9pmc\""
Jul 07 02:48:59.800389 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.800361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:48:59.825417 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825417 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.825876 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.825687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzvr\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926176 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926176 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzvr\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926672    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926739    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926922 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926764    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.926922 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.926866    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.927161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.927141    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.928912 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.928887    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.929132 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.929113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.935738 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.935711    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:48:59.936025 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:48:59.936004    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svzvr\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr\") pod \"e2e-inf-a-606263-openshift-default-5b687d8779-vg274\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") " pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:00.099332 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.099232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:00.243057 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.243026    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:49:00.245440 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:49:00.245406    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef1266b_6ed4_41ce_93ea_434e9a2619d7.slice/crio-279b0c465fe918d7fc6b04d286bdb77f9b5dc297f725aec76004db9146abb36c WatchSource:0}: Error finding container 279b0c465fe918d7fc6b04d286bdb77f9b5dc297f725aec76004db9146abb36c: Status 404 returned error can't find the container with id 279b0c465fe918d7fc6b04d286bdb77f9b5dc297f725aec76004db9146abb36c
Jul 07 02:49:00.247814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.247777    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:00.247917 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.247856    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:00.247917 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.247885    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:00.461468 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.461375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerStarted","Data":"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"}
Jul 07 02:49:00.461468 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.461440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerStarted","Data":"279b0c465fe918d7fc6b04d286bdb77f9b5dc297f725aec76004db9146abb36c"}
Jul 07 02:49:00.483814 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:00.483745    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podStartSLOduration=1.483723208 podStartE2EDuration="1.483723208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:00.482410804 +0000 UTC m=+2053.880409150" watchObservedRunningTime="2026-07-07 02:49:00.483723208 +0000 UTC m=+2053.881721542"
Jul 07 02:49:01.099538 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:01.099492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:01.100965 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:01.100941    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:01.101070 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:01.100998    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:02.103961 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.103924    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:02.471589 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.471508    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:02.472460 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.472440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:02.600711 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.600669    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:49:02.601038 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.601025    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:49:02.601038 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.601038    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7b85c0-49f3-4ae2-b251-c266fd6d22e8" containerName="istio-proxy"
Jul 07 02:49:02.604287 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.604261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.607195 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.607166    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-606263-serving-cert\""
Jul 07 02:49:02.613142 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.613114    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:49:02.650502 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.650469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.650725 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.650514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.650725 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.650628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgbqt\" (UniqueName: \"kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.751433 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.751399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.751646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.751481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgbqt\" (UniqueName: \"kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.751646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.751507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.751737 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:49:02.751599    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-606263-serving-cert: secret "maas-api-e2e-inf-a-606263-serving-cert" not found
Jul 07 02:49:02.751737 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:49:02.751706    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls podName:f843599c-9d86-4530-a55c-26d8dce9ee47 nodeName:}" failed. No retries permitted until 2026-07-07 02:49:03.251691424 +0000 UTC m=+2056.649689734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls") pod "maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" (UID: "f843599c-9d86-4530-a55c-26d8dce9ee47") : secret "maas-api-e2e-inf-a-606263-serving-cert" not found
Jul 07 02:49:02.752165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.752145    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:02.763009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:02.762980    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgbqt\" (UniqueName: \"kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:03.255515 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:03.255474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:03.258157 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:03.258125    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") pod \"maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") " pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:03.516350 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:03.516252    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:03.657595 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:03.657560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:49:03.658598 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:49:03.658568    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf843599c_9d86_4530_a55c_26d8dce9ee47.slice/crio-bdd0464d3b465f41cad68f7627bdc9ef7ee32608e70439bd3dbbbee763dceb06 WatchSource:0}: Error finding container bdd0464d3b465f41cad68f7627bdc9ef7ee32608e70439bd3dbbbee763dceb06: Status 404 returned error can't find the container with id bdd0464d3b465f41cad68f7627bdc9ef7ee32608e70439bd3dbbbee763dceb06
Jul 07 02:49:03.660145 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:03.660115    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 02:49:04.481842 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:04.481807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" event={"ID":"f843599c-9d86-4530-a55c-26d8dce9ee47","Type":"ContainerStarted","Data":"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"}
Jul 07 02:49:04.482252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:04.481864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" event={"ID":"f843599c-9d86-4530-a55c-26d8dce9ee47","Type":"ContainerStarted","Data":"bdd0464d3b465f41cad68f7627bdc9ef7ee32608e70439bd3dbbbee763dceb06"}
Jul 07 02:49:04.482252 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:04.482020    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:04.501444 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:04.501392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" podStartSLOduration=2.076759787 podStartE2EDuration="2.501373483s" totalImagesPullingTime="424.613696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:04.501302797 +0000 UTC m=+2057.899301314" watchObservedRunningTime="2026-07-07 02:49:04.501373483 +0000 UTC m=+2057.899371814"
Jul 07 02:49:10.491419 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:10.491339    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:49:11.040324 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.040254    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:49:11.071334 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.070835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:49:11.071334 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.071004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.075150 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.075118    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-decb12-serving-cert\""
Jul 07 02:49:11.126439 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.126402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.126666 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.126459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.126666 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.126587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nffb4\" (UniqueName: \"kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.227317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.227273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.227529 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.227330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.227529 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.227388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nffb4\" (UniqueName: \"kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.227529 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:49:11.227424    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-decb12-serving-cert: secret "maas-api-e2e-inf-b-decb12-serving-cert" not found
Jul 07 02:49:11.227529 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:49:11.227489    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls podName:e818f734-55e7-43dc-aabf-2113f97aeb98 nodeName:}" failed. No retries permitted until 2026-07-07 02:49:11.727471905 +0000 UTC m=+2065.125470215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls") pod "maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" (UID: "e818f734-55e7-43dc-aabf-2113f97aeb98") : secret "maas-api-e2e-inf-b-decb12-serving-cert" not found
Jul 07 02:49:11.228084 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.228065    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.239076 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.239009    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nffb4\" (UniqueName: \"kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.734238 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.734196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.737879 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.737844    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") pod \"maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") " pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:11.983460 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:11.983423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:12.186078 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:12.186046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:49:12.188808 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:49:12.188774    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode818f734_55e7_43dc_aabf_2113f97aeb98.slice/crio-83f2546c29bbc6dea8241dd3d777d290ce99a35702e8d7934bf48f2e1f5b617b WatchSource:0}: Error finding container 83f2546c29bbc6dea8241dd3d777d290ce99a35702e8d7934bf48f2e1f5b617b: Status 404 returned error can't find the container with id 83f2546c29bbc6dea8241dd3d777d290ce99a35702e8d7934bf48f2e1f5b617b
Jul 07 02:49:12.521936 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:12.521898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" event={"ID":"e818f734-55e7-43dc-aabf-2113f97aeb98","Type":"ContainerStarted","Data":"83f2546c29bbc6dea8241dd3d777d290ce99a35702e8d7934bf48f2e1f5b617b"}
Jul 07 02:49:13.528994 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:13.528957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" event={"ID":"e818f734-55e7-43dc-aabf-2113f97aeb98","Type":"ContainerStarted","Data":"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"}
Jul 07 02:49:13.529382 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:13.529080    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:13.562741 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:13.562658    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" podStartSLOduration=2.197216604 podStartE2EDuration="2.562633255s" totalImagesPullingTime="365.416651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:49:13.561002662 +0000 UTC m=+2066.959000987" watchObservedRunningTime="2026-07-07 02:49:13.562633255 +0000 UTC m=+2066.960631590"
Jul 07 02:49:17.472900 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.472809    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:17.472900 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.472866    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:17.554051 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.554013    2559 generic.go:356] "Generic (PLEG): container finished" podID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerID="c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed" exitCode=0
Jul 07 02:49:17.554225 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.554093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerDied","Data":"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"}
Jul 07 02:49:17.554586 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.554564    2559 scope.go:117] "RemoveContainer" containerID="c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"
Jul 07 02:49:17.555752 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.555715    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:17.555855 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.555812    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:17.555912 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:17.555867    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:49:18.574977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:18.574942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerStarted","Data":"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"}
Jul 07 02:49:19.099767 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:19.099733    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:19.100087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:19.100053    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:19.100216 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:19.100133    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:19.550911 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:19.550869    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:49:20.100288 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:20.100248    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:20.100732 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:20.100324    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:21.100457 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:21.100423    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:21.100850 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:21.100478    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:22.100260 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:22.100223    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 02:49:22.100455 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:22.100287    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 02:49:23.103951 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:23.103918    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:23.104343 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:23.104190    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:49:23.105042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:49:23.105025    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:50:21.274408 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.274367    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:50:21.275025 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.274631    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" podUID="f843599c-9d86-4530-a55c-26d8dce9ee47" containerName="maas-api" containerID="cri-o://ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801" gracePeriod=30
Jul 07 02:50:21.724826 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.724799    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:50:21.792977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.792939    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca\") pod \"f843599c-9d86-4530-a55c-26d8dce9ee47\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") "
Jul 07 02:50:21.793175 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.793006    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgbqt\" (UniqueName: \"kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt\") pod \"f843599c-9d86-4530-a55c-26d8dce9ee47\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") "
Jul 07 02:50:21.793175 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.793033    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") pod \"f843599c-9d86-4530-a55c-26d8dce9ee47\" (UID: \"f843599c-9d86-4530-a55c-26d8dce9ee47\") "
Jul 07 02:50:21.793327 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.793301    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f843599c-9d86-4530-a55c-26d8dce9ee47" (UID: "f843599c-9d86-4530-a55c-26d8dce9ee47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:50:21.795297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.795267    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f843599c-9d86-4530-a55c-26d8dce9ee47" (UID: "f843599c-9d86-4530-a55c-26d8dce9ee47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:50:21.795506 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.795483    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt" (OuterVolumeSpecName: "kube-api-access-cgbqt") pod "f843599c-9d86-4530-a55c-26d8dce9ee47" (UID: "f843599c-9d86-4530-a55c-26d8dce9ee47"). InnerVolumeSpecName "kube-api-access-cgbqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:50:21.892380 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.892344    2559 generic.go:356] "Generic (PLEG): container finished" podID="f843599c-9d86-4530-a55c-26d8dce9ee47" containerID="ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801" exitCode=0
Jul 07 02:50:21.892596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.892400    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"
Jul 07 02:50:21.892596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.892437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" event={"ID":"f843599c-9d86-4530-a55c-26d8dce9ee47","Type":"ContainerDied","Data":"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"}
Jul 07 02:50:21.892596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.892496    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8" event={"ID":"f843599c-9d86-4530-a55c-26d8dce9ee47","Type":"ContainerDied","Data":"bdd0464d3b465f41cad68f7627bdc9ef7ee32608e70439bd3dbbbee763dceb06"}
Jul 07 02:50:21.892596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.892526    2559 scope.go:117] "RemoveContainer" containerID="ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"
Jul 07 02:50:21.893740 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.893723    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f843599c-9d86-4530-a55c-26d8dce9ee47-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:50:21.893837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.893742    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgbqt\" (UniqueName: \"kubernetes.io/projected/f843599c-9d86-4530-a55c-26d8dce9ee47-kube-api-access-cgbqt\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:50:21.893837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.893753    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f843599c-9d86-4530-a55c-26d8dce9ee47-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:50:21.902056 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.902036    2559 scope.go:117] "RemoveContainer" containerID="ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"
Jul 07 02:50:21.902355 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:50:21.902336    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801\": container with ID starting with ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801 not found: ID does not exist" containerID="ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"
Jul 07 02:50:21.902406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.902364    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801"} err="failed to get container status \"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801\": rpc error: code = NotFound desc = could not find container \"ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801\": container with ID starting with ccfacc41e7785756020a6da82ec764838873b4aaecf523bde1c27834a96cc801 not found: ID does not exist"
Jul 07 02:50:21.915833 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.915787    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:50:21.919437 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:21.919412    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-606263-69b68d9dc5-jtqp8"]
Jul 07 02:50:23.154100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:50:23.154062    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f843599c-9d86-4530-a55c-26d8dce9ee47" path="/var/lib/kubelet/pods/f843599c-9d86-4530-a55c-26d8dce9ee47/volumes"
Jul 07 02:51:03.183886 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:03.180838    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:51:03.183886 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:03.181201    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" containerID="cri-o://b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b" gracePeriod=30
Jul 07 02:51:04.453837 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.453804    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:51:04.454292 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.454038    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerName="maas-api" containerID="cri-o://920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5" gracePeriod=30
Jul 07 02:51:04.537352 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.537306    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.58:8443/health\": dial tcp 10.132.0.58:8443: connect: connection refused"
Jul 07 02:51:04.708209 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.708141    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:51:04.768731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.768691    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") pod \"e818f734-55e7-43dc-aabf-2113f97aeb98\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") "
Jul 07 02:51:04.768731 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.768734    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca\") pod \"e818f734-55e7-43dc-aabf-2113f97aeb98\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") "
Jul 07 02:51:04.768991 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.768796    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nffb4\" (UniqueName: \"kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4\") pod \"e818f734-55e7-43dc-aabf-2113f97aeb98\" (UID: \"e818f734-55e7-43dc-aabf-2113f97aeb98\") "
Jul 07 02:51:04.769129 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.769097    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e818f734-55e7-43dc-aabf-2113f97aeb98" (UID: "e818f734-55e7-43dc-aabf-2113f97aeb98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:04.771019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.770986    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e818f734-55e7-43dc-aabf-2113f97aeb98" (UID: "e818f734-55e7-43dc-aabf-2113f97aeb98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:51:04.771019 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.770997    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4" (OuterVolumeSpecName: "kube-api-access-nffb4") pod "e818f734-55e7-43dc-aabf-2113f97aeb98" (UID: "e818f734-55e7-43dc-aabf-2113f97aeb98"). InnerVolumeSpecName "kube-api-access-nffb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:04.869695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.869658    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e818f734-55e7-43dc-aabf-2113f97aeb98-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:04.869695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.869689    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e818f734-55e7-43dc-aabf-2113f97aeb98-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:04.869695 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:04.869699    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nffb4\" (UniqueName: \"kubernetes.io/projected/e818f734-55e7-43dc-aabf-2113f97aeb98-kube-api-access-nffb4\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:05.105794 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.105759    2559 generic.go:356] "Generic (PLEG): container finished" podID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerID="920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5" exitCode=0
Jul 07 02:51:05.105990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.105813    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"
Jul 07 02:51:05.105990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.105850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" event={"ID":"e818f734-55e7-43dc-aabf-2113f97aeb98","Type":"ContainerDied","Data":"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"}
Jul 07 02:51:05.105990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.105915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st" event={"ID":"e818f734-55e7-43dc-aabf-2113f97aeb98","Type":"ContainerDied","Data":"83f2546c29bbc6dea8241dd3d777d290ce99a35702e8d7934bf48f2e1f5b617b"}
Jul 07 02:51:05.105990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.105947    2559 scope.go:117] "RemoveContainer" containerID="920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"
Jul 07 02:51:05.117683 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.117657    2559 scope.go:117] "RemoveContainer" containerID="920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"
Jul 07 02:51:05.118007 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:05.117986    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5\": container with ID starting with 920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5 not found: ID does not exist" containerID="920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"
Jul 07 02:51:05.118069 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.118017    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5"} err="failed to get container status \"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5\": rpc error: code = NotFound desc = could not find container \"920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5\": container with ID starting with 920c0dfffa671486ba21c8c601f417db4c98753f4ea124c6a67791ee322456e5 not found: ID does not exist"
Jul 07 02:51:05.134925 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.134876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:51:05.139376 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.139349    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-decb12-5c8d66c4c8-bk4st"]
Jul 07 02:51:05.156423 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:05.156391    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" path="/var/lib/kubelet/pods/e818f734-55e7-43dc-aabf-2113f97aeb98/volumes"
Jul 07 02:51:08.107015 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.106979    2559 patch_prober.go:28] interesting pod/e2e-inf-a-606263-openshift-default-5b687d8779-vg274 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:51:08.107394 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.107053    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:51:08.452449 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.452416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:51:08.501853 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.501825    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.501877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.501925    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svzvr\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.501964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.501990    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502279 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502158    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502279 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502279 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502232    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502279 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502156    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:08.502488 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket\") pod \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\" (UID: \"aef1266b-6ed4-41ce-93ea-434e9a2619d7\") "
Jul 07 02:51:08.502543 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502373    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:08.502598 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502552    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:08.502736 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502643    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.502736 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502665    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.502854 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502826    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:08.502980 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.502952    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:08.504466 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.504440    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:08.504759 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.504731    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:08.504916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.504895    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:51:08.505007 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.504988    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr" (OuterVolumeSpecName: "kube-api-access-svzvr") pod "aef1266b-6ed4-41ce-93ea-434e9a2619d7" (UID: "aef1266b-6ed4-41ce-93ea-434e9a2619d7"). InnerVolumeSpecName "kube-api-access-svzvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:08.603276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603231    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603265    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603274    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603285    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef1266b-6ed4-41ce-93ea-434e9a2619d7-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603558 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603295    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svzvr\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-kube-api-access-svzvr\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603558 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603304    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:08.603558 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:08.603312    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef1266b-6ed4-41ce-93ea-434e9a2619d7-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:09.137325 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.137291    2559 generic.go:356] "Generic (PLEG): container finished" podID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerID="b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b" exitCode=0
Jul 07 02:51:09.137838 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.137367    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"
Jul 07 02:51:09.137838 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.137378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerDied","Data":"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"}
Jul 07 02:51:09.137838 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.137480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274" event={"ID":"aef1266b-6ed4-41ce-93ea-434e9a2619d7","Type":"ContainerDied","Data":"279b0c465fe918d7fc6b04d286bdb77f9b5dc297f725aec76004db9146abb36c"}
Jul 07 02:51:09.137838 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.137513    2559 scope.go:117] "RemoveContainer" containerID="b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"
Jul 07 02:51:09.147942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.147920    2559 scope.go:117] "RemoveContainer" containerID="c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"
Jul 07 02:51:09.157250 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.157226    2559 scope.go:117] "RemoveContainer" containerID="b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"
Jul 07 02:51:09.157525 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:09.157505    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b\": container with ID starting with b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b not found: ID does not exist" containerID="b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"
Jul 07 02:51:09.157576 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.157534    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b"} err="failed to get container status \"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b\": rpc error: code = NotFound desc = could not find container \"b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b\": container with ID starting with b0003ba0a57bccfb37f861f2d79493a1625113997547160f60dbc5ba7851ff5b not found: ID does not exist"
Jul 07 02:51:09.157576 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.157553    2559 scope.go:117] "RemoveContainer" containerID="c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"
Jul 07 02:51:09.157848 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:09.157831    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed\": container with ID starting with c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed not found: ID does not exist" containerID="c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"
Jul 07 02:51:09.157907 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.157851    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed"} err="failed to get container status \"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed\": rpc error: code = NotFound desc = could not find container \"c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed\": container with ID starting with c47600c8a6026088b3b39dbfd96c12ce4dc510cda9da1a97cf5028925251ceed not found: ID does not exist"
Jul 07 02:51:09.169892 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.169852    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:51:09.177165 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:09.177131    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-606263-openshift-default-5b687d8779-vg274"]
Jul 07 02:51:11.154847 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.154814    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" path="/var/lib/kubelet/pods/aef1266b-6ed4-41ce-93ea-434e9a2619d7/volumes"
Jul 07 02:51:11.551595 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551558    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:11.551968 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551954    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f843599c-9d86-4530-a55c-26d8dce9ee47" containerName="maas-api"
Jul 07 02:51:11.552010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551970    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f843599c-9d86-4530-a55c-26d8dce9ee47" containerName="maas-api"
Jul 07 02:51:11.552010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551980    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerName="maas-api"
Jul 07 02:51:11.552010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551986    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerName="maas-api"
Jul 07 02:51:11.552010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.551996    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.552010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552002    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552015    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552021    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f843599c-9d86-4530-a55c-26d8dce9ee47" containerName="maas-api"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552089    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e818f734-55e7-43dc-aabf-2113f97aeb98" containerName="maas-api"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552097    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.552169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.552103    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef1266b-6ed4-41ce-93ea-434e9a2619d7" containerName="istio-proxy"
Jul 07 02:51:11.556534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.556510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.561596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.561575    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f004df-openshift-default-dockercfg-jl6px\""
Jul 07 02:51:11.576216 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.576187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:11.630836 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.630795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.630896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnc62\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.630933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.630969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.630996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.631089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.631122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.631142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.631363 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.631214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732456 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnc62\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.732700 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.732902    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733193 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.733154    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733425 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.733381    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733714 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.733677    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.733834 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.733800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.735441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.735411    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.735441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.735427    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.744989 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.744963    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.745140 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.745122    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnc62\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62\") pod \"e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") " pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:11.867177 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:11.867078    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:12.014575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.014542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:12.016371 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:51:12.016341    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20866cc_02d5_49d3_9e96_26631b65cc65.slice/crio-082cc7ac3e80a7ab8034df8d82584b08255f6845fb2d7e60f161cb4c4f359d4e WatchSource:0}: Error finding container 082cc7ac3e80a7ab8034df8d82584b08255f6845fb2d7e60f161cb4c4f359d4e: Status 404 returned error can't find the container with id 082cc7ac3e80a7ab8034df8d82584b08255f6845fb2d7e60f161cb4c4f359d4e
Jul 07 02:51:12.018520 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.018487    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:12.018626 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.018555    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:12.018626 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.018586    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:12.156679 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.156574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerStarted","Data":"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"}
Jul 07 02:51:12.157140 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.156684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerStarted","Data":"082cc7ac3e80a7ab8034df8d82584b08255f6845fb2d7e60f161cb4c4f359d4e"}
Jul 07 02:51:12.188889 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.188835    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podStartSLOduration=1.1888159090000001 podStartE2EDuration="1.188815909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:12.185340059 +0000 UTC m=+2185.583338397" watchObservedRunningTime="2026-07-07 02:51:12.188815909 +0000 UTC m=+2185.586814240"
Jul 07 02:51:12.868085 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:12.868039    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:13.873790 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:13.873760    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:14.166173 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.166079    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:14.167006 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.166987    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:14.491998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.491961    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:14.495115 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.495097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.498860 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.498839    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-f004df-serving-cert\""
Jul 07 02:51:14.527471 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.527427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:14.560629 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.560555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.560792 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.560638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.560792 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.560674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q2f2\" (UniqueName: \"kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.661283 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.661241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q2f2\" (UniqueName: \"kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.661490 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.661371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.661490 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.661408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.661676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:14.661528    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-f004df-serving-cert: secret "maas-api-e2e-api-a-f004df-serving-cert" not found
Jul 07 02:51:14.661676 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:14.661657    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls podName:2fac2ab5-2829-48fc-b871-18c7bba58400 nodeName:}" failed. No retries permitted until 2026-07-07 02:51:15.161600857 +0000 UTC m=+2188.559599167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls") pod "maas-api-e2e-api-a-f004df-796bd99cff-vll64" (UID: "2fac2ab5-2829-48fc-b871-18c7bba58400") : secret "maas-api-e2e-api-a-f004df-serving-cert" not found
Jul 07 02:51:14.662119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.662095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:14.672495 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:14.672464    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q2f2\" (UniqueName: \"kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:15.165878 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:15.165835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:15.168672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:15.168635    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") pod \"maas-api-e2e-api-a-f004df-796bd99cff-vll64\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") " pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:15.406454 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:15.406412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:15.563624 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:15.563577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:15.565516 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:51:15.565485    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fac2ab5_2829_48fc_b871_18c7bba58400.slice/crio-8a4475860505de62cb91308161e82494f055fb6f3695e960fe786526ec8a5313 WatchSource:0}: Error finding container 8a4475860505de62cb91308161e82494f055fb6f3695e960fe786526ec8a5313: Status 404 returned error can't find the container with id 8a4475860505de62cb91308161e82494f055fb6f3695e960fe786526ec8a5313
Jul 07 02:51:16.178485 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:16.178448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" event={"ID":"2fac2ab5-2829-48fc-b871-18c7bba58400","Type":"ContainerStarted","Data":"26386c5e1c465e7143ea2a4e231cc00bc886cb986a2e6307ff7ef5d10b9d8a53"}
Jul 07 02:51:16.178950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:16.178507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" event={"ID":"2fac2ab5-2829-48fc-b871-18c7bba58400","Type":"ContainerStarted","Data":"8a4475860505de62cb91308161e82494f055fb6f3695e960fe786526ec8a5313"}
Jul 07 02:51:16.178950 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:16.178707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:16.208205 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:16.208149    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" podStartSLOduration=1.731719412 podStartE2EDuration="2.208131095s" totalImagesPullingTime="476.411683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:16.205940162 +0000 UTC m=+2189.603938496" watchObservedRunningTime="2026-07-07 02:51:16.208131095 +0000 UTC m=+2189.606129426"
Jul 07 02:51:22.189154 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.189123    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:22.665509 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.665477    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:22.669034 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.669010    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.673024 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.672995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-67cea6-serving-cert\""
Jul 07 02:51:22.684653 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.684600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:22.731810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.731776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.732043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.731846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4bfl\" (UniqueName: \"kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.732043 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.731947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.833540 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.833494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4bfl\" (UniqueName: \"kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.833764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.833582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.833764 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.833720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.833913 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:22.833838    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-67cea6-serving-cert: secret "maas-api-e2e-api-b-67cea6-serving-cert" not found
Jul 07 02:51:22.833975 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:22.833915    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls podName:96f08fd9-e737-4ad7-84e1-1b464c826073 nodeName:}" failed. No retries permitted until 2026-07-07 02:51:23.333892931 +0000 UTC m=+2196.731891257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls") pod "maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" (UID: "96f08fd9-e737-4ad7-84e1-1b464c826073") : secret "maas-api-e2e-api-b-67cea6-serving-cert" not found
Jul 07 02:51:22.834341 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.834318    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:22.850962 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:22.850919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4bfl\" (UniqueName: \"kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:23.340407 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:23.339836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:23.344560 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:23.344496    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") pod \"maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") " pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:23.582021 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:23.581982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:23.807123 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:23.807096    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:23.808870 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:51:23.808834    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f08fd9_e737_4ad7_84e1_1b464c826073.slice/crio-1e5359a3d142995e3ca0936ca1cd9c20e0ac852068f1fa58e828ad09b5b8a875 WatchSource:0}: Error finding container 1e5359a3d142995e3ca0936ca1cd9c20e0ac852068f1fa58e828ad09b5b8a875: Status 404 returned error can't find the container with id 1e5359a3d142995e3ca0936ca1cd9c20e0ac852068f1fa58e828ad09b5b8a875
Jul 07 02:51:24.218813 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:24.218776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" event={"ID":"96f08fd9-e737-4ad7-84e1-1b464c826073","Type":"ContainerStarted","Data":"1e5359a3d142995e3ca0936ca1cd9c20e0ac852068f1fa58e828ad09b5b8a875"}
Jul 07 02:51:25.225276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:25.225234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" event={"ID":"96f08fd9-e737-4ad7-84e1-1b464c826073","Type":"ContainerStarted","Data":"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"}
Jul 07 02:51:25.225719 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:25.225320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:25.245591 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:25.245515    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" podStartSLOduration=2.810073482 podStartE2EDuration="3.24549066s" totalImagesPullingTime="435.417178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:25.243519485 +0000 UTC m=+2198.641517818" watchObservedRunningTime="2026-07-07 02:51:25.24549066 +0000 UTC m=+2198.643488994"
Jul 07 02:51:29.702924 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:29.702873    2559 patch_prober.go:28] interesting pod/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:49174->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Jul 07 02:51:29.703285 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:29.702952    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:49174->10.132.0.59:15021: read: connection reset by peer"
Jul 07 02:51:30.256601 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.256562    2559 generic.go:356] "Generic (PLEG): container finished" podID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerID="812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006" exitCode=0
Jul 07 02:51:30.256800 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.256637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerDied","Data":"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"}
Jul 07 02:51:30.257050 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.257036    2559 scope.go:117] "RemoveContainer" containerID="812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"
Jul 07 02:51:30.258169 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.258137    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:30.258242 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.258226    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:30.258280 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:30.258268    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:31.249991 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:31.249949    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:31.265773 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:31.265737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerStarted","Data":"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"}
Jul 07 02:51:31.867693 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:31.867655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:31.867929 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:31.867907    2559 patch_prober.go:28] interesting pod/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 02:51:31.867977 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:31.867956    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 02:51:32.867558 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:32.867518    2559 patch_prober.go:28] interesting pod/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 02:51:32.867982 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:32.867583    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 02:51:33.867785 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:33.867743    2559 patch_prober.go:28] interesting pod/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 02:51:33.868221 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:33.867824    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 02:51:34.868353 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:34.868310    2559 patch_prober.go:28] interesting pod/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 02:51:34.868810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:34.868386    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 02:51:35.872071 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:35.872037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:35.872539 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:35.872378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:35.873269 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:35.873249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:36.108631 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.107939    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:36.108631 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.108239    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" podUID="2fac2ab5-2829-48fc-b871-18c7bba58400" containerName="maas-api" containerID="cri-o://26386c5e1c465e7143ea2a4e231cc00bc886cb986a2e6307ff7ef5d10b9d8a53" gracePeriod=30
Jul 07 02:51:36.294458 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.294421    2559 generic.go:356] "Generic (PLEG): container finished" podID="2fac2ab5-2829-48fc-b871-18c7bba58400" containerID="26386c5e1c465e7143ea2a4e231cc00bc886cb986a2e6307ff7ef5d10b9d8a53" exitCode=0
Jul 07 02:51:36.294652 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.294581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" event={"ID":"2fac2ab5-2829-48fc-b871-18c7bba58400","Type":"ContainerDied","Data":"26386c5e1c465e7143ea2a4e231cc00bc886cb986a2e6307ff7ef5d10b9d8a53"}
Jul 07 02:51:36.364163 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.364139    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:36.489323 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.489286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q2f2\" (UniqueName: \"kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2\") pod \"2fac2ab5-2829-48fc-b871-18c7bba58400\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") "
Jul 07 02:51:36.489501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.489344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca\") pod \"2fac2ab5-2829-48fc-b871-18c7bba58400\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") "
Jul 07 02:51:36.489501 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.489481    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") pod \"2fac2ab5-2829-48fc-b871-18c7bba58400\" (UID: \"2fac2ab5-2829-48fc-b871-18c7bba58400\") "
Jul 07 02:51:36.489705 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.489683    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fac2ab5-2829-48fc-b871-18c7bba58400" (UID: "2fac2ab5-2829-48fc-b871-18c7bba58400"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:36.489772 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.489756    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fac2ab5-2829-48fc-b871-18c7bba58400-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:36.491646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.491594    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2" (OuterVolumeSpecName: "kube-api-access-8q2f2") pod "2fac2ab5-2829-48fc-b871-18c7bba58400" (UID: "2fac2ab5-2829-48fc-b871-18c7bba58400"). InnerVolumeSpecName "kube-api-access-8q2f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:36.491646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.491594    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fac2ab5-2829-48fc-b871-18c7bba58400" (UID: "2fac2ab5-2829-48fc-b871-18c7bba58400"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:51:36.590967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.590916    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fac2ab5-2829-48fc-b871-18c7bba58400-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:36.590967 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:36.590959    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q2f2\" (UniqueName: \"kubernetes.io/projected/2fac2ab5-2829-48fc-b871-18c7bba58400-kube-api-access-8q2f2\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:37.300496 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:37.300465    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"
Jul 07 02:51:37.300953 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:37.300505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64" event={"ID":"2fac2ab5-2829-48fc-b871-18c7bba58400","Type":"ContainerDied","Data":"8a4475860505de62cb91308161e82494f055fb6f3695e960fe786526ec8a5313"}
Jul 07 02:51:37.300953 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:37.300568    2559 scope.go:117] "RemoveContainer" containerID="26386c5e1c465e7143ea2a4e231cc00bc886cb986a2e6307ff7ef5d10b9d8a53"
Jul 07 02:51:37.325414 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:37.325378    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:37.333080 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:37.333040    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f004df-796bd99cff-vll64"]
Jul 07 02:51:39.155822 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:39.155782    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fac2ab5-2829-48fc-b871-18c7bba58400" path="/var/lib/kubelet/pods/2fac2ab5-2829-48fc-b871-18c7bba58400/volumes"
Jul 07 02:51:42.449087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:42.449055    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:42.449533 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:42.449264    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy" containerID="cri-o://b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41" gracePeriod=30
Jul 07 02:51:43.923802 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:43.923764    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:43.924291 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:43.923995    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" podUID="96f08fd9-e737-4ad7-84e1-1b464c826073" containerName="maas-api" containerID="cri-o://73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6" gracePeriod=30
Jul 07 02:51:44.180011 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.179947    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:44.262115 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.262079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4bfl\" (UniqueName: \"kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl\") pod \"96f08fd9-e737-4ad7-84e1-1b464c826073\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") "
Jul 07 02:51:44.262310 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.262131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca\") pod \"96f08fd9-e737-4ad7-84e1-1b464c826073\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") "
Jul 07 02:51:44.262310 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.262184    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") pod \"96f08fd9-e737-4ad7-84e1-1b464c826073\" (UID: \"96f08fd9-e737-4ad7-84e1-1b464c826073\") "
Jul 07 02:51:44.262585 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.262561    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96f08fd9-e737-4ad7-84e1-1b464c826073" (UID: "96f08fd9-e737-4ad7-84e1-1b464c826073"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:44.264466 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.264442    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96f08fd9-e737-4ad7-84e1-1b464c826073" (UID: "96f08fd9-e737-4ad7-84e1-1b464c826073"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:51:44.264546 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.264491    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl" (OuterVolumeSpecName: "kube-api-access-v4bfl") pod "96f08fd9-e737-4ad7-84e1-1b464c826073" (UID: "96f08fd9-e737-4ad7-84e1-1b464c826073"). InnerVolumeSpecName "kube-api-access-v4bfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:44.338711 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.338672    2559 generic.go:356] "Generic (PLEG): container finished" podID="96f08fd9-e737-4ad7-84e1-1b464c826073" containerID="73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6" exitCode=0
Jul 07 02:51:44.338905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.338734    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"
Jul 07 02:51:44.338905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.338761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" event={"ID":"96f08fd9-e737-4ad7-84e1-1b464c826073","Type":"ContainerDied","Data":"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"}
Jul 07 02:51:44.338905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.338827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm" event={"ID":"96f08fd9-e737-4ad7-84e1-1b464c826073","Type":"ContainerDied","Data":"1e5359a3d142995e3ca0936ca1cd9c20e0ac852068f1fa58e828ad09b5b8a875"}
Jul 07 02:51:44.338905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.338857    2559 scope.go:117] "RemoveContainer" containerID="73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"
Jul 07 02:51:44.348368 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.348339    2559 scope.go:117] "RemoveContainer" containerID="73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"
Jul 07 02:51:44.348677 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:44.348659    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6\": container with ID starting with 73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6 not found: ID does not exist" containerID="73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"
Jul 07 02:51:44.348746 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.348687    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6"} err="failed to get container status \"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6\": rpc error: code = NotFound desc = could not find container \"73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6\": container with ID starting with 73ae98274cd087371794d63c1f59624b590a5841e0822612aa287651287ddea6 not found: ID does not exist"
Jul 07 02:51:44.363235 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.363209    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:44.363523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.363507    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4bfl\" (UniqueName: \"kubernetes.io/projected/96f08fd9-e737-4ad7-84e1-1b464c826073-kube-api-access-v4bfl\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:44.363567 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.363526    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f08fd9-e737-4ad7-84e1-1b464c826073-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:44.363567 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.363537    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f08fd9-e737-4ad7-84e1-1b464c826073-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:44.370229 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:44.370205    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-67cea6-6dd8dd66cd-xchxm"]
Jul 07 02:51:45.154347 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:45.154311    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f08fd9-e737-4ad7-84e1-1b464c826073" path="/var/lib/kubelet/pods/96f08fd9-e737-4ad7-84e1-1b464c826073/volumes"
Jul 07 02:51:47.714265 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.714202    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:47.795730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795694    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795730    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795758    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795793    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795817    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795853    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795918    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.795998 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.795960    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.796367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796003    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnc62\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62\") pod \"d20866cc-02d5-49d3-9e96-26631b65cc65\" (UID: \"d20866cc-02d5-49d3-9e96-26631b65cc65\") "
Jul 07 02:51:47.796367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796041    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:47.796367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796287    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:47.796367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796295    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.796367 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796320    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:51:47.796646 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796404    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:47.796710 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.796692    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data" (OuterVolumeSpecName: "istio-data") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:47.798156 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.798129    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token" (OuterVolumeSpecName: "istio-token") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:47.798250 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.798226    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:51:47.798847 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.798822    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:51:47.798847 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.798828    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62" (OuterVolumeSpecName: "kube-api-access-lnc62") pod "d20866cc-02d5-49d3-9e96-26631b65cc65" (UID: "d20866cc-02d5-49d3-9e96-26631b65cc65"). InnerVolumeSpecName "kube-api-access-lnc62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:51:47.897469 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897428    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897469 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897462    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897469 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897472    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897469 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897481    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnc62\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-kube-api-access-lnc62\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897491    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897498    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897507    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20866cc-02d5-49d3-9e96-26631b65cc65-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:47.897782 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:47.897514    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20866cc-02d5-49d3-9e96-26631b65cc65-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:51:48.369313 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.369274    2559 generic.go:356] "Generic (PLEG): container finished" podID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerID="b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41" exitCode=0
Jul 07 02:51:48.369526 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.369368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerDied","Data":"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"}
Jul 07 02:51:48.369526 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.369464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr" event={"ID":"d20866cc-02d5-49d3-9e96-26631b65cc65","Type":"ContainerDied","Data":"082cc7ac3e80a7ab8034df8d82584b08255f6845fb2d7e60f161cb4c4f359d4e"}
Jul 07 02:51:48.369526 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.369380    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"
Jul 07 02:51:48.369526 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.369494    2559 scope.go:117] "RemoveContainer" containerID="b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"
Jul 07 02:51:48.380133 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.380059    2559 scope.go:117] "RemoveContainer" containerID="812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"
Jul 07 02:51:48.390476 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.390416    2559 scope.go:117] "RemoveContainer" containerID="b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"
Jul 07 02:51:48.390745 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:48.390724    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41\": container with ID starting with b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41 not found: ID does not exist" containerID="b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"
Jul 07 02:51:48.390788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.390756    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41"} err="failed to get container status \"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41\": rpc error: code = NotFound desc = could not find container \"b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41\": container with ID starting with b1ad98c8808d8c2de33a10eb4d4316ec7608d70da6d70a8f85183a70f8326d41 not found: ID does not exist"
Jul 07 02:51:48.390788 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.390776    2559 scope.go:117] "RemoveContainer" containerID="812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"
Jul 07 02:51:48.391013 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:48.390994    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006\": container with ID starting with 812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006 not found: ID does not exist" containerID="812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"
Jul 07 02:51:48.391066 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.391017    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006"} err="failed to get container status \"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006\": rpc error: code = NotFound desc = could not find container \"812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006\": container with ID starting with 812b9ae43940b1fa5d611159d4e4ec3faade588be25c4c558fae15df66b10006 not found: ID does not exist"
Jul 07 02:51:48.402573 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.402537    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:48.404297 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:48.404272    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f004df-openshift-default-7f87d6d479-vvwkr"]
Jul 07 02:51:49.154649 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:49.154597    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" path="/var/lib/kubelet/pods/d20866cc-02d5-49d3-9e96-26631b65cc65/volumes"
Jul 07 02:51:50.969064 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969026    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969377    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969387    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969399    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f08fd9-e737-4ad7-84e1-1b464c826073" containerName="maas-api"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969405    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f08fd9-e737-4ad7-84e1-1b464c826073" containerName="maas-api"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969416    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fac2ab5-2829-48fc-b871-18c7bba58400" containerName="maas-api"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969421    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fac2ab5-2829-48fc-b871-18c7bba58400" containerName="maas-api"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969428    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969459 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969434    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969733 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969490    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969733 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969498    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20866cc-02d5-49d3-9e96-26631b65cc65" containerName="istio-proxy"
Jul 07 02:51:50.969733 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969506    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f08fd9-e737-4ad7-84e1-1b464c826073" containerName="maas-api"
Jul 07 02:51:50.969733 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.969512    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fac2ab5-2829-48fc-b871-18c7bba58400" containerName="maas-api"
Jul 07 02:51:50.971719 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.971703    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:50.978447 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:50.978167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bb462a-openshift-default-dockercfg-m57g6\""
Jul 07 02:51:51.008077 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.008046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:51:51.029054 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpth\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029227 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029409 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029409 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029409 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.029409 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.029362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130290 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130523 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpth\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130889 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130734    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130889 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130929    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.130990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.130969    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.131389 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.131264    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.132896 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.132864    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.133058 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.133042    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.154163 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.154100    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpth\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.156452 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.156423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token\") pod \"e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") " pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.282249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.282206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:51.455943 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.455915    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:51:51.457791 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:51:51.457764    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c497d9_892d_44a2_9328_316748b61d35.slice/crio-947022f823ffd380879ba5cc25df842bd7dc33c90d9a8258ba39fa9481322e2e WatchSource:0}: Error finding container 947022f823ffd380879ba5cc25df842bd7dc33c90d9a8258ba39fa9481322e2e: Status 404 returned error can't find the container with id 947022f823ffd380879ba5cc25df842bd7dc33c90d9a8258ba39fa9481322e2e
Jul 07 02:51:51.460253 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.460216    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:51.460356 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.460327    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:51.460406 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:51.460360    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:51:52.395573 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:52.395537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerStarted","Data":"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"}
Jul 07 02:51:52.396061 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:52.395595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerStarted","Data":"947022f823ffd380879ba5cc25df842bd7dc33c90d9a8258ba39fa9481322e2e"}
Jul 07 02:51:52.433121 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:52.433033    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podStartSLOduration=2.433010861 podStartE2EDuration="2.433010861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:52.432842118 +0000 UTC m=+2225.830840452" watchObservedRunningTime="2026-07-07 02:51:52.433010861 +0000 UTC m=+2225.831009194"
Jul 07 02:51:53.283371 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:53.283335    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:53.288315 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:53.288285    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:53.400204 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:53.400175    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:53.401059 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:53.401035    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:51:54.638185 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.638147    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:51:54.641276 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.641253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.644777 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.644755    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-bb462a-serving-cert\""
Jul 07 02:51:54.664364 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.664336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:51:54.767697 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.767624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.767900 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.767711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.767900 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.767863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkv2k\" (UniqueName: \"kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.868987 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.868946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.869160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.868997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.869160 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.869054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkv2k\" (UniqueName: \"kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.869270 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:54.869182    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-bb462a-serving-cert: secret "maas-api-e2e-shared-a-bb462a-serving-cert" not found
Jul 07 02:51:54.869318 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:51:54.869274    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls podName:5b356ac6-8f99-4a60-b47f-30e6b3bd400f nodeName:}" failed. No retries permitted until 2026-07-07 02:51:55.369251653 +0000 UTC m=+2228.767249963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls") pod "maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" (UID: "5b356ac6-8f99-4a60-b47f-30e6b3bd400f") : secret "maas-api-e2e-shared-a-bb462a-serving-cert" not found
Jul 07 02:51:54.869793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.869774    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:54.888905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:54.888836    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkv2k\" (UniqueName: \"kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:55.372766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:55.372720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:55.375335 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:55.375303    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") pod \"maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") " pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:55.552863 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:55.552821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:55.728582 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:55.728552    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:51:55.729928 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:51:55.729897    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b356ac6_8f99_4a60_b47f_30e6b3bd400f.slice/crio-36536b902a5de1d0787dabcc19fae9bfc9425de4ef04adca488e569fa710974f WatchSource:0}: Error finding container 36536b902a5de1d0787dabcc19fae9bfc9425de4ef04adca488e569fa710974f: Status 404 returned error can't find the container with id 36536b902a5de1d0787dabcc19fae9bfc9425de4ef04adca488e569fa710974f
Jul 07 02:51:56.416269 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:56.416176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" event={"ID":"5b356ac6-8f99-4a60-b47f-30e6b3bd400f","Type":"ContainerStarted","Data":"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"}
Jul 07 02:51:56.416269 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:56.416227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" event={"ID":"5b356ac6-8f99-4a60-b47f-30e6b3bd400f","Type":"ContainerStarted","Data":"36536b902a5de1d0787dabcc19fae9bfc9425de4ef04adca488e569fa710974f"}
Jul 07 02:51:56.416466 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:56.416277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:51:56.475061 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:51:56.475007    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" podStartSLOduration=2.173864304 podStartE2EDuration="2.474991069s" totalImagesPullingTime="301.126765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:51:56.473844947 +0000 UTC m=+2229.871843279" watchObservedRunningTime="2026-07-07 02:51:56.474991069 +0000 UTC m=+2229.872989402"
Jul 07 02:52:02.427578 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:02.427544    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:52:03.072521 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.072476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:52:03.076803 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.076777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.086394 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.086375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-890bdd-serving-cert\""
Jul 07 02:52:03.105422 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.105391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:52:03.156267 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.156220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwh8\" (UniqueName: \"kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.156805 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.156761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.156990 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.156970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.258257 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.258211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwh8\" (UniqueName: \"kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.258480 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.258371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.258480 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.258400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.258745 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:52:03.258720    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-890bdd-serving-cert: secret "maas-api-e2e-shared-b-890bdd-serving-cert" not found
Jul 07 02:52:03.258823 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:52:03.258796    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls podName:b630fef1-c625-4464-80bc-d87b33424c4c nodeName:}" failed. No retries permitted until 2026-07-07 02:52:03.758772566 +0000 UTC m=+2237.156770876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls") pod "maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" (UID: "b630fef1-c625-4464-80bc-d87b33424c4c") : secret "maas-api-e2e-shared-b-890bdd-serving-cert" not found
Jul 07 02:52:03.259308 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.259284    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.278511 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.278478    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwh8\" (UniqueName: \"kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.763087 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.763042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.765872 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.765838    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") " pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:03.988702 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:03.988661    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:04.163942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:04.163913    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:52:04.165874 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:52:04.165829    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb630fef1_c625_4464_80bc_d87b33424c4c.slice/crio-bb2569213b3da3f9d34aebd526d5a9c793089cf27ce3fedbb4c488cac9bcb26d WatchSource:0}: Error finding container bb2569213b3da3f9d34aebd526d5a9c793089cf27ce3fedbb4c488cac9bcb26d: Status 404 returned error can't find the container with id bb2569213b3da3f9d34aebd526d5a9c793089cf27ce3fedbb4c488cac9bcb26d
Jul 07 02:52:04.472072 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:04.471988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" event={"ID":"b630fef1-c625-4464-80bc-d87b33424c4c","Type":"ContainerStarted","Data":"bb2569213b3da3f9d34aebd526d5a9c793089cf27ce3fedbb4c488cac9bcb26d"}
Jul 07 02:52:05.478595 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:05.478545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" event={"ID":"b630fef1-c625-4464-80bc-d87b33424c4c","Type":"ContainerStarted","Data":"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"}
Jul 07 02:52:05.479050 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:05.478703    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:07.491153 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.491077    2559 generic.go:356] "Generic (PLEG): container finished" podID="55c497d9-892d-44a2-9328-316748b61d35" containerID="097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c" exitCode=0
Jul 07 02:52:07.491547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.491153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerDied","Data":"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"}
Jul 07 02:52:07.491547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.491528    2559 scope.go:117] "RemoveContainer" containerID="097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"
Jul 07 02:52:07.492531 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.492505    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:52:07.492587 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.492571    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:52:07.492645 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.492629    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 02:52:07.529527 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:07.529466    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" podStartSLOduration=4.225516789 podStartE2EDuration="4.529443731s" totalImagesPullingTime="303.926942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 02:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:52:05.511839123 +0000 UTC m=+2238.909837455" watchObservedRunningTime="2026-07-07 02:52:07.529443731 +0000 UTC m=+2240.927442065"
Jul 07 02:52:08.400249 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:08.400205    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:52:08.498067 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:08.498031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerStarted","Data":"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"}
Jul 07 02:52:09.282730 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:09.282689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:52:09.283917 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:09.283891    2559 patch_prober.go:28] interesting pod/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 02:52:09.284033 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:09.283939    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 02:52:10.283136 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:10.283091    2559 patch_prober.go:28] interesting pod/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 02:52:10.283664 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:10.283156    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 02:52:11.283315 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:11.283277    2559 patch_prober.go:28] interesting pod/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 02:52:11.283740 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:11.283332    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 02:52:11.490565 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:11.490537    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:52:12.282819 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:12.282778    2559 patch_prober.go:28] interesting pod/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 07 02:52:12.283017 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:12.282870    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 07 02:52:13.287319 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:13.287282    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:52:13.287755 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:13.287577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:52:13.288411 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:52:13.288392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:58:28.826441 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:28.826361    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:58:28.827120 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:28.826583    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" podUID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" containerName="maas-api" containerID="cri-o://759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94" gracePeriod=30
Jul 07 02:58:29.084394 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.084335    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:58:29.199918 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.199885    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca\") pod \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") "
Jul 07 02:58:29.200100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.199946    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") pod \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") "
Jul 07 02:58:29.200100 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.199982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkv2k\" (UniqueName: \"kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k\") pod \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\" (UID: \"5b356ac6-8f99-4a60-b47f-30e6b3bd400f\") "
Jul 07 02:58:29.200295 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.200277    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b356ac6-8f99-4a60-b47f-30e6b3bd400f" (UID: "5b356ac6-8f99-4a60-b47f-30e6b3bd400f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:58:29.202161 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.202137    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b356ac6-8f99-4a60-b47f-30e6b3bd400f" (UID: "5b356ac6-8f99-4a60-b47f-30e6b3bd400f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:58:29.202224 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.202189    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k" (OuterVolumeSpecName: "kube-api-access-fkv2k") pod "5b356ac6-8f99-4a60-b47f-30e6b3bd400f" (UID: "5b356ac6-8f99-4a60-b47f-30e6b3bd400f"). InnerVolumeSpecName "kube-api-access-fkv2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:58:29.301083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.301045    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:58:29.301083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.301075    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:58:29.301083 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.301086    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkv2k\" (UniqueName: \"kubernetes.io/projected/5b356ac6-8f99-4a60-b47f-30e6b3bd400f-kube-api-access-fkv2k\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:58:29.389810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.389708    2559 generic.go:356] "Generic (PLEG): container finished" podID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" containerID="759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94" exitCode=0
Jul 07 02:58:29.389810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.389770    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"
Jul 07 02:58:29.389810 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.389784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" event={"ID":"5b356ac6-8f99-4a60-b47f-30e6b3bd400f","Type":"ContainerDied","Data":"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"}
Jul 07 02:58:29.390119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.389881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf" event={"ID":"5b356ac6-8f99-4a60-b47f-30e6b3bd400f","Type":"ContainerDied","Data":"36536b902a5de1d0787dabcc19fae9bfc9425de4ef04adca488e569fa710974f"}
Jul 07 02:58:29.390119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.389914    2559 scope.go:117] "RemoveContainer" containerID="759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"
Jul 07 02:58:29.399021 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.399003    2559 scope.go:117] "RemoveContainer" containerID="759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"
Jul 07 02:58:29.399277 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:58:29.399258    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94\": container with ID starting with 759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94 not found: ID does not exist" containerID="759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"
Jul 07 02:58:29.399327 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.399286    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94"} err="failed to get container status \"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94\": rpc error: code = NotFound desc = could not find container \"759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94\": container with ID starting with 759de1db7236a6dd40de022b0adbb10c261f9de815b18dddccc6485f2e5f8f94 not found: ID does not exist"
Jul 07 02:58:29.414454 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.414426    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:58:29.416216 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:29.416195    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-bb462a-bbbdfd7f5-5rnnf"]
Jul 07 02:58:31.155056 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:58:31.155020    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" path="/var/lib/kubelet/pods/5b356ac6-8f99-4a60-b47f-30e6b3bd400f/volumes"
Jul 07 02:59:10.688302 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:10.688267    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:59:10.688910 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:10.688502    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" containerID="cri-o://4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35" gracePeriod=30
Jul 07 02:59:11.852769 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:11.852729    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:59:11.853259 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:11.852973    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" podUID="b630fef1-c625-4464-80bc-d87b33424c4c" containerName="maas-api" containerID="cri-o://67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c" gracePeriod=30
Jul 07 02:59:12.110622 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.110546    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:59:12.182575 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.182533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") pod \"b630fef1-c625-4464-80bc-d87b33424c4c\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") "
Jul 07 02:59:12.182811 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.182597    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca\") pod \"b630fef1-c625-4464-80bc-d87b33424c4c\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") "
Jul 07 02:59:12.182811 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.182655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbwh8\" (UniqueName: \"kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8\") pod \"b630fef1-c625-4464-80bc-d87b33424c4c\" (UID: \"b630fef1-c625-4464-80bc-d87b33424c4c\") "
Jul 07 02:59:12.183069 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.183043    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b630fef1-c625-4464-80bc-d87b33424c4c" (UID: "b630fef1-c625-4464-80bc-d87b33424c4c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:59:12.184905 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.184875    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b630fef1-c625-4464-80bc-d87b33424c4c" (UID: "b630fef1-c625-4464-80bc-d87b33424c4c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 02:59:12.185025 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.184911    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8" (OuterVolumeSpecName: "kube-api-access-lbwh8") pod "b630fef1-c625-4464-80bc-d87b33424c4c" (UID: "b630fef1-c625-4464-80bc-d87b33424c4c"). InnerVolumeSpecName "kube-api-access-lbwh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:59:12.283865 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.283832    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b630fef1-c625-4464-80bc-d87b33424c4c-maas-api-tls\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:12.283865 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.283863    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b630fef1-c625-4464-80bc-d87b33424c4c-openshift-service-ca\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:12.283865 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.283872    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbwh8\" (UniqueName: \"kubernetes.io/projected/b630fef1-c625-4464-80bc-d87b33424c4c-kube-api-access-lbwh8\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:12.602749 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.602706    2559 generic.go:356] "Generic (PLEG): container finished" podID="b630fef1-c625-4464-80bc-d87b33424c4c" containerID="67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c" exitCode=0
Jul 07 02:59:12.602959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.602758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"
Jul 07 02:59:12.602959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.602806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" event={"ID":"b630fef1-c625-4464-80bc-d87b33424c4c","Type":"ContainerDied","Data":"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"}
Jul 07 02:59:12.602959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.602866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx" event={"ID":"b630fef1-c625-4464-80bc-d87b33424c4c","Type":"ContainerDied","Data":"bb2569213b3da3f9d34aebd526d5a9c793089cf27ce3fedbb4c488cac9bcb26d"}
Jul 07 02:59:12.602959 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.602895    2559 scope.go:117] "RemoveContainer" containerID="67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"
Jul 07 02:59:12.612074 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.612052    2559 scope.go:117] "RemoveContainer" containerID="67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"
Jul 07 02:59:12.612334 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:59:12.612313    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c\": container with ID starting with 67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c not found: ID does not exist" containerID="67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"
Jul 07 02:59:12.612380 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.612346    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c"} err="failed to get container status \"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c\": rpc error: code = NotFound desc = could not find container \"67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c\": container with ID starting with 67ece23e0b9497fb4ab26e1797af75038a92dfc445b79729d4f7e3028705ce6c not found: ID does not exist"
Jul 07 02:59:12.624813 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.624787    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:59:12.630084 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:12.630058    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-890bdd-7dd8d66668-gjsnx"]
Jul 07 02:59:13.154916 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:13.154884    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b630fef1-c625-4464-80bc-d87b33424c4c" path="/var/lib/kubelet/pods/b630fef1-c625-4464-80bc-d87b33424c4c/volumes"
Jul 07 02:59:13.289824 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:13.289778    2559 patch_prober.go:28] interesting pod/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 02:59:13.289995 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:13.289899    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 02:59:15.950471 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:15.950401    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:59:16.022578 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plpth\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022593    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022640    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.022806 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.023119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022825    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.023119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.022849    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket\") pod \"55c497d9-892d-44a2-9328-316748b61d35\" (UID: \"55c497d9-892d-44a2-9328-316748b61d35\") "
Jul 07 02:59:16.023119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023009    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:16.023119 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023071    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:16.023321 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023125    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-certs\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.023321 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023209    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:16.023596 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023363    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 02:59:16.023724 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.023702    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data" (OuterVolumeSpecName: "istio-data") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:16.025056 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.025029    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth" (OuterVolumeSpecName: "kube-api-access-plpth") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "kube-api-access-plpth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:59:16.025298 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.025276    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 02:59:16.025428 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.025407    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 02:59:16.025473 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.025412    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token" (OuterVolumeSpecName: "istio-token") pod "55c497d9-892d-44a2-9328-316748b61d35" (UID: "55c497d9-892d-44a2-9328-316748b61d35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 02:59:16.123884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123838    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-istio-token\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.123884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123870    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-workload-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.123884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123881    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-data\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.123884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123889    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c497d9-892d-44a2-9328-316748b61d35-istiod-ca-cert\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.123884 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123897    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-credential-socket\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.124317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123906    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plpth\" (UniqueName: \"kubernetes.io/projected/55c497d9-892d-44a2-9328-316748b61d35-kube-api-access-plpth\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.124317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123915    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c497d9-892d-44a2-9328-316748b61d35-istio-podinfo\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.124317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.123923    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c497d9-892d-44a2-9328-316748b61d35-istio-envoy\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 02:59:16.624942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.624902    2559 generic.go:356] "Generic (PLEG): container finished" podID="55c497d9-892d-44a2-9328-316748b61d35" containerID="4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35" exitCode=0
Jul 07 02:59:16.625122 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.624955    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"
Jul 07 02:59:16.625122 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.624994    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerDied","Data":"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"}
Jul 07 02:59:16.625122 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.625050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh" event={"ID":"55c497d9-892d-44a2-9328-316748b61d35","Type":"ContainerDied","Data":"947022f823ffd380879ba5cc25df842bd7dc33c90d9a8258ba39fa9481322e2e"}
Jul 07 02:59:16.625122 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.625081    2559 scope.go:117] "RemoveContainer" containerID="4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"
Jul 07 02:59:16.635644 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.635600    2559 scope.go:117] "RemoveContainer" containerID="097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"
Jul 07 02:59:16.644009 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.643987    2559 scope.go:117] "RemoveContainer" containerID="4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"
Jul 07 02:59:16.644368 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:59:16.644344    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35\": container with ID starting with 4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35 not found: ID does not exist" containerID="4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"
Jul 07 02:59:16.644453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.644382    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35"} err="failed to get container status \"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35\": rpc error: code = NotFound desc = could not find container \"4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35\": container with ID starting with 4f5d38cfcea881efbf98be62d9f45799a28883ac75b5312dc83d06ed35757b35 not found: ID does not exist"
Jul 07 02:59:16.644453 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.644410    2559 scope.go:117] "RemoveContainer" containerID="097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"
Jul 07 02:59:16.644713 ip-10-0-142-72 kubenswrapper[2559]: E0707 02:59:16.644695    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c\": container with ID starting with 097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c not found: ID does not exist" containerID="097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"
Jul 07 02:59:16.644790 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.644719    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c"} err="failed to get container status \"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c\": rpc error: code = NotFound desc = could not find container \"097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c\": container with ID starting with 097d81a1b314fa5ead46c3cd66506c66b960c2e320163e8f99974eb5b82a329c not found: ID does not exist"
Jul 07 02:59:16.647618 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.647578    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:59:16.653535 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:16.653507    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bb462a-openshift-default-667d6bdf99-nvczh"]
Jul 07 02:59:17.154188 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:17.154158    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c497d9-892d-44a2-9328-316748b61d35" path="/var/lib/kubelet/pods/55c497d9-892d-44a2-9328-316748b61d35/volumes"
Jul 07 02:59:23.032418 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.032389    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-667967ddd6-75j5h_711339e7-5444-4213-afe8-f3fcdfbf30f9/maas-api/0.log"
Jul 07 02:59:23.144323 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.144293    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723190-wkrjw_d12e534e-38a2-4a25-870e-2496825f92d8/cleanup/0.log"
Jul 07 02:59:23.250315 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.250284    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723205-555jw_012a7938-124e-4180-94de-989c9fd46bc2/cleanup/0.log"
Jul 07 02:59:23.375672 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.375563    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-568f884b76-wmmwc_58451629-373f-4792-bff4-9305b9b7c842/manager/0.log"
Jul 07 02:59:23.841102 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.841073    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r44fw_f99fdbc0-8829-4cf5-9d79-20b976ec0252/copy-manifests/0.log"
Jul 07 02:59:23.848492 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:23.848469    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r44fw_f99fdbc0-8829-4cf5-9d79-20b976ec0252/manager/0.log"
Jul 07 02:59:24.082317 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:24.082285    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jpx2m_1a32eed5-6f91-4872-86b6-fb78650deaf3/postgres/0.log"
Jul 07 02:59:25.510586 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:25.510558    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5qrpl_96af44e2-9bb9-4aff-acdf-6f8ca45a8f18/manager/0.log"
Jul 07 02:59:25.626239 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:25.626206    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h28c6_381cc729-b948-43f3-a229-18c21ff7f951/manager/0.log"
Jul 07 02:59:25.857770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:25.857685    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ppgjc_5568fad6-744a-4771-9bf5-4df49c21bfc3/registry-server/0.log"
Jul 07 02:59:25.975849 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:25.975813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ksqxb_b68d03f6-14ce-43e3-a370-bafef66e0c7c/manager/0.log"
Jul 07 02:59:26.202733 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:26.202646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gk5hj_e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a/manager/0.log"
Jul 07 02:59:26.664388 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:26.664360    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pzclc_f36a3c00-2c1c-47aa-be48-0e3f2f7fc673/discovery/0.log"
Jul 07 02:59:27.020481 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:27.020447    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/1.log"
Jul 07 02:59:27.135236 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:27.135208    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xhskl_83789f6d-dc39-46d0-911b-131dea77fb5d/payload-pre-processing/0.log"
Jul 07 02:59:27.255061 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:27.255029    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zpnjl_834ec390-94e3-42a0-a0df-75354a1e08fd/payload-processing/0.log"
Jul 07 02:59:27.714517 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:27.714486    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bl7qp_ea512196-cb9d-4157-96cc-b372e85d64b1/main/0.log"
Jul 07 02:59:27.832706 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:27.832671    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-z52lt_248bdf19-a63a-4ceb-a519-1dfbcbd68324/main/0.log"
Jul 07 02:59:28.182883 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:28.182851    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pk5vp_ec42f714-13a0-412c-aad9-40974c22567e/main/0.log"
Jul 07 02:59:35.748270 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:35.748235    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9sb67_9cdbf32e-b191-461f-9320-eeed64359999/global-pull-secret-syncer/0.log"
Jul 07 02:59:35.881018 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:35.880981    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fd69w_3731445d-3047-4c7e-bd3e-5e107723fcb0/konnectivity-agent/0.log"
Jul 07 02:59:35.992010 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:35.991982    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-72.ec2.internal_b0ce01185dfdcbc31d8e5ab0d9274554/haproxy/0.log"
Jul 07 02:59:40.928323 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:40.928241    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5qrpl_96af44e2-9bb9-4aff-acdf-6f8ca45a8f18/manager/0.log"
Jul 07 02:59:40.959675 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:40.959650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-h28c6_381cc729-b948-43f3-a229-18c21ff7f951/manager/0.log"
Jul 07 02:59:41.049941 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:41.049904    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ppgjc_5568fad6-744a-4771-9bf5-4df49c21bfc3/registry-server/0.log"
Jul 07 02:59:41.168179 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:41.168149    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ksqxb_b68d03f6-14ce-43e3-a370-bafef66e0c7c/manager/0.log"
Jul 07 02:59:41.278941 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:41.278909    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gk5hj_e1d99e95-5cc9-4ef1-b556-43c0f87e7d2a/manager/0.log"
Jul 07 02:59:43.379306 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:43.379225    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzfgg_cbac583a-6cf3-429f-ab5e-fea69a23c878/node-exporter/0.log"
Jul 07 02:59:43.418793 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:43.418763    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzfgg_cbac583a-6cf3-429f-ab5e-fea69a23c878/kube-rbac-proxy/0.log"
Jul 07 02:59:43.445195 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:43.445168    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fzfgg_cbac583a-6cf3-429f-ab5e-fea69a23c878/init-textfile/0.log"
Jul 07 02:59:45.378933 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:45.378900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rmjpr_cacbed8a-b8a3-4d4e-a90f-088073fc07fb/networking-console-plugin/0.log"
Jul 07 02:59:46.162247 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162209    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"]
Jul 07 02:59:46.162585 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162572    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b630fef1-c625-4464-80bc-d87b33424c4c" containerName="maas-api"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162587    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b630fef1-c625-4464-80bc-d87b33424c4c" containerName="maas-api"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162621    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" containerName="maas-api"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162627    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" containerName="maas-api"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162634    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162639    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162648    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162660 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162655    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162710    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b630fef1-c625-4464-80bc-d87b33424c4c" containerName="maas-api"
Jul 07 02:59:46.162942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162719    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162725    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c497d9-892d-44a2-9328-316748b61d35" containerName="istio-proxy"
Jul 07 02:59:46.162942 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.162729    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b356ac6-8f99-4a60-b47f-30e6b3bd400f" containerName="maas-api"
Jul 07 02:59:46.166044 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.166020    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.169104 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.169080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"openshift-service-ca.crt\""
Jul 07 02:59:46.169245 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.169207    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wtppw\"/\"kube-root-ca.crt\""
Jul 07 02:59:46.170766 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.170747    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wtppw\"/\"default-dockercfg-npm2w\""
Jul 07 02:59:46.176188 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.176165    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"]
Jul 07 02:59:46.298426 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.298388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-proc\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.298426 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.298430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-podres\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.298690 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.298503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9pv\" (UniqueName: \"kubernetes.io/projected/8c13ed94-513f-4e0a-899f-9740ffee0df5-kube-api-access-5n9pv\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.298690 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.298559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-sys\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.298690 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.298588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-lib-modules\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399428 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-proc\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399428 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-podres\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9pv\" (UniqueName: \"kubernetes.io/projected/8c13ed94-513f-4e0a-899f-9740ffee0df5-kube-api-access-5n9pv\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399531    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-proc\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399580    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-podres\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-sys\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399689    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-sys\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399686    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-lib-modules\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.399960 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.399800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c13ed94-513f-4e0a-899f-9740ffee0df5-lib-modules\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.408871 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.408843    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9pv\" (UniqueName: \"kubernetes.io/projected/8c13ed94-513f-4e0a-899f-9740ffee0df5-kube-api-access-5n9pv\") pod \"perf-node-gather-daemonset-mtgkl\" (UID: \"8c13ed94-513f-4e0a-899f-9740ffee0df5\") " pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.477112 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.477015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.617720 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.617696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"]
Jul 07 02:59:46.619770 ip-10-0-142-72 kubenswrapper[2559]: W0707 02:59:46.619741    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c13ed94_513f_4e0a_899f_9740ffee0df5.slice/crio-1a9e70e36868ba7409f082fc3b814e9bf7168c199fc94ed34ee9eb74e01c35d4 WatchSource:0}: Error finding container 1a9e70e36868ba7409f082fc3b814e9bf7168c199fc94ed34ee9eb74e01c35d4: Status 404 returned error can't find the container with id 1a9e70e36868ba7409f082fc3b814e9bf7168c199fc94ed34ee9eb74e01c35d4
Jul 07 02:59:46.772371 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.772331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl" event={"ID":"8c13ed94-513f-4e0a-899f-9740ffee0df5","Type":"ContainerStarted","Data":"3a63900c2d3e51f574513e745acb828e44e89c5e7c9ef78a7191a7a713e0cc5d"}
Jul 07 02:59:46.772548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.772395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl" event={"ID":"8c13ed94-513f-4e0a-899f-9740ffee0df5","Type":"ContainerStarted","Data":"1a9e70e36868ba7409f082fc3b814e9bf7168c199fc94ed34ee9eb74e01c35d4"}
Jul 07 02:59:46.772548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.772425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:46.793316 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:46.793263    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl" podStartSLOduration=0.793246868 podStartE2EDuration="793.246868ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 02:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 02:59:46.79268274 +0000 UTC m=+2700.190681073" watchObservedRunningTime="2026-07-07 02:59:46.793246868 +0000 UTC m=+2700.191245216"
Jul 07 02:59:48.456566 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:48.456529    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxmtt_c1f0f6b2-a049-4b9c-b5e5-56afc465ebef/dns/0.log"
Jul 07 02:59:48.480322 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:48.480295    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxmtt_c1f0f6b2-a049-4b9c-b5e5-56afc465ebef/kube-rbac-proxy/0.log"
Jul 07 02:59:48.661832 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:48.661794    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x47k6_898a7b93-f6d5-41ac-9d47-5e1261bca15b/dns-node-resolver/0.log"
Jul 07 02:59:49.254623 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:49.254577    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68szx_eb3bdc6a-893c-458a-b3b5-88d95070e432/node-ca/0.log"
Jul 07 02:59:50.423878 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:50.423837    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pzclc_f36a3c00-2c1c-47aa-be48-0e3f2f7fc673/discovery/0.log"
Jul 07 02:59:50.522313 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:50.522279    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/0.log"
Jul 07 02:59:50.549230 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:50.549185    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/1.log"
Jul 07 02:59:50.589921 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:50.589895    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xhskl_83789f6d-dc39-46d0-911b-131dea77fb5d/payload-pre-processing/0.log"
Jul 07 02:59:50.643560 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:50.643527    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zpnjl_834ec390-94e3-42a0-a0df-75354a1e08fd/payload-processing/0.log"
Jul 07 02:59:51.455424 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:51.455394    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfsq5_a53ca3f8-8ba1-424a-a78d-12c0466ddcbd/serve-healthcheck-canary/0.log"
Jul 07 02:59:52.158260 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:52.158229    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6lwt_ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4/kube-rbac-proxy/0.log"
Jul 07 02:59:52.181534 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:52.181505    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6lwt_ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4/exporter/0.log"
Jul 07 02:59:52.206245 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:52.206194    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v6lwt_ae92b5c1-b43c-4b19-ba3b-ea84bbe391d4/extractor/0.log"
Jul 07 02:59:52.788018 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:52.787987    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wtppw/perf-node-gather-daemonset-mtgkl"
Jul 07 02:59:54.736577 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:54.736539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-667967ddd6-75j5h_711339e7-5444-4213-afe8-f3fcdfbf30f9/maas-api/0.log"
Jul 07 02:59:54.759184 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:54.759154    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723190-wkrjw_d12e534e-38a2-4a25-870e-2496825f92d8/cleanup/0.log"
Jul 07 02:59:54.792557 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:54.792527    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723205-555jw_012a7938-124e-4180-94de-989c9fd46bc2/cleanup/0.log"
Jul 07 02:59:54.902639 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:54.901038    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-568f884b76-wmmwc_58451629-373f-4792-bff4-9305b9b7c842/manager/0.log"
Jul 07 02:59:55.100281 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:55.100182    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r44fw_f99fdbc0-8829-4cf5-9d79-20b976ec0252/manager/0.log"
Jul 07 02:59:55.123770 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:55.123739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-778f769c96-r44fw_f99fdbc0-8829-4cf5-9d79-20b976ec0252/copy-manifests/0.log"
Jul 07 02:59:55.266182 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:55.266158    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-jpx2m_1a32eed5-6f91-4872-86b6-fb78650deaf3/postgres/0.log"
Jul 07 02:59:56.857026 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:56.856995    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5vcbx_925d3fe3-f356-4b60-af5e-a691c66ed091/openshift-lws-operator/0.log"
Jul 07 02:59:57.274210 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:57.274172    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pzclc_f36a3c00-2c1c-47aa-be48-0e3f2f7fc673/discovery/0.log"
Jul 07 02:59:57.346024 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:57.345996    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/0.log"
Jul 07 02:59:57.375891 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:57.375859    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/1.log"
Jul 07 02:59:57.402042 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:57.401998    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xhskl_83789f6d-dc39-46d0-911b-131dea77fb5d/payload-pre-processing/0.log"
Jul 07 02:59:57.457547 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:57.457517    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zpnjl_834ec390-94e3-42a0-a0df-75354a1e08fd/payload-processing/0.log"
Jul 07 02:59:58.827314 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:58.827285    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pzclc_f36a3c00-2c1c-47aa-be48-0e3f2f7fc673/discovery/0.log"
Jul 07 02:59:58.886924 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:58.886890    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/0.log"
Jul 07 02:59:58.919548 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:58.919517    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-6pmgx_b5bbac12-4cd6-45a1-b591-6cbc9d6cfeeb/istio-proxy/1.log"
Jul 07 02:59:58.945783 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:58.945745    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-xhskl_83789f6d-dc39-46d0-911b-131dea77fb5d/payload-pre-processing/0.log"
Jul 07 02:59:58.985265 ip-10-0-142-72 kubenswrapper[2559]: I0707 02:59:58.985236    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zpnjl_834ec390-94e3-42a0-a0df-75354a1e08fd/payload-processing/0.log"
Jul 07 03:00:00.136027 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.135980    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723220-7gfpl"]
Jul 07 03:00:00.143179 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.143152    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:00.146842 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.146812    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723220-7gfpl"]
Jul 07 03:00:00.225201 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.225164    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpfb9\" (UniqueName: \"kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9\") pod \"maas-api-key-cleanup-29723220-7gfpl\" (UID: \"84887588-7a8e-4747-bcfe-64c6e6dd2c51\") " pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:00.326427 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.326376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpfb9\" (UniqueName: \"kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9\") pod \"maas-api-key-cleanup-29723220-7gfpl\" (UID: \"84887588-7a8e-4747-bcfe-64c6e6dd2c51\") " pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:00.336625 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.336579    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpfb9\" (UniqueName: \"kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9\") pod \"maas-api-key-cleanup-29723220-7gfpl\" (UID: \"84887588-7a8e-4747-bcfe-64c6e6dd2c51\") " pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:00.455208 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.455116    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:00.676849 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.674985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723220-7gfpl"]
Jul 07 03:00:00.681518 ip-10-0-142-72 kubenswrapper[2559]: W0707 03:00:00.681487    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84887588_7a8e_4747_bcfe_64c6e6dd2c51.slice/crio-594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346 WatchSource:0}: Error finding container 594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346: Status 404 returned error can't find the container with id 594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346
Jul 07 03:00:00.838692 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:00.838642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl" event={"ID":"84887588-7a8e-4747-bcfe-64c6e6dd2c51","Type":"ContainerStarted","Data":"594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346"}
Jul 07 03:00:01.844891 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:01.844858    2559 generic.go:356] "Generic (PLEG): container finished" podID="84887588-7a8e-4747-bcfe-64c6e6dd2c51" containerID="522a0997adaa68937efd0285fb6bc5a870c47964a59fa5c7d42dd1f187d4acfd" exitCode=0
Jul 07 03:00:01.845343 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:01.845006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl" event={"ID":"84887588-7a8e-4747-bcfe-64c6e6dd2c51","Type":"ContainerDied","Data":"522a0997adaa68937efd0285fb6bc5a870c47964a59fa5c7d42dd1f187d4acfd"}
Jul 07 03:00:02.995720 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:02.995686    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:03.052337 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.052295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpfb9\" (UniqueName: \"kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9\") pod \"84887588-7a8e-4747-bcfe-64c6e6dd2c51\" (UID: \"84887588-7a8e-4747-bcfe-64c6e6dd2c51\") "
Jul 07 03:00:03.054709 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.054672    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9" (OuterVolumeSpecName: "kube-api-access-lpfb9") pod "84887588-7a8e-4747-bcfe-64c6e6dd2c51" (UID: "84887588-7a8e-4747-bcfe-64c6e6dd2c51"). InnerVolumeSpecName "kube-api-access-lpfb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 03:00:03.153436 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.153355    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpfb9\" (UniqueName: \"kubernetes.io/projected/84887588-7a8e-4747-bcfe-64c6e6dd2c51-kube-api-access-lpfb9\") on node \"ip-10-0-142-72.ec2.internal\" DevicePath \"\""
Jul 07 03:00:03.736974 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.736940    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/kube-multus-additional-cni-plugins/0.log"
Jul 07 03:00:03.759904 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.759874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/egress-router-binary-copy/0.log"
Jul 07 03:00:03.783568 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.783535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/cni-plugins/0.log"
Jul 07 03:00:03.807975 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.807945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/bond-cni-plugin/0.log"
Jul 07 03:00:03.833739 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.833707    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/routeoverride-cni/0.log"
Jul 07 03:00:03.855063 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.855029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl" event={"ID":"84887588-7a8e-4747-bcfe-64c6e6dd2c51","Type":"ContainerDied","Data":"594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346"}
Jul 07 03:00:03.855225 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.855088    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="594ccc31eb86e7e8e513f2f86a1cdc3238d7cd01f59e974c2ea094fae7739346"
Jul 07 03:00:03.855225 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.855035    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723220-7gfpl"
Jul 07 03:00:03.858735 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.858713    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/whereabouts-cni-bincopy/0.log"
Jul 07 03:00:03.883787 ip-10-0-142-72 kubenswrapper[2559]: I0707 03:00:03.883761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sk56z_e070bbb3-86d8-4ce0-85e9-a06580b82315/whereabouts-cni/0.log"