Jul 06 02:37:22.725631 ip-10-0-139-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 02:37:22.725642 ip-10-0-139-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 02:37:22.725651 ip-10-0-139-33 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 02:37:22.726050 ip-10-0-139-33 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 02:37:32.871872 ip-10-0-139-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 02:37:32.871888 ip-10-0-139-33 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d78cd290a5164e9a8b35478aef36f752 --
Jul 06 02:39:25.525770 ip-10-0-139-33 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 02:39:26.018119 ip-10-0-139-33 systemd[1]: Started Kubernetes Kubelet.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.947510    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951841    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951854    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951857    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951860    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951863    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951866    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951869    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.022192 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951872    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951874    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951878    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951881    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951884    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951886    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951889    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951892    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951894    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951897    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951900    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951902    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951905    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951907    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951913    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951918    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951921    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951924    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951926    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.023833 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951929    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951932    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951935    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951937    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951940    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951943    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951945    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951948    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951950    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951953    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951955    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951958    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951960    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951963    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951965    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951967    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951970    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951974    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951977    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.025565 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951980    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951984    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951986    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951989    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951992    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951995    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.951998    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952000    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952003    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952007    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952009    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952012    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952015    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952018    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952021    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952025    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952028    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952031    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952033    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952036    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.026458 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952039    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952042    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952045    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952047    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952050    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952053    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952055    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952058    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952060    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952063    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952066    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952069    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952072    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952075    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952077    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952081    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952084    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952087    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952090    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.027529 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952093    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952096    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952099    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952102    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952105    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952108    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952111    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952113    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952116    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952119    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952121    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952124    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952127    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952130    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952132    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952852    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952859    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952861    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952865    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952867    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.030042 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952870    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952873    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952876    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952878    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952881    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952884    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952886    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952889    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952892    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952894    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952897    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952901    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952904    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952907    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952909    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952912    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952915    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952917    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952920    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.030914 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952924    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952928    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952931    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952934    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952936    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952940    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952943    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952946    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952949    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952952    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952954    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952957    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952959    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952962    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952964    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952967    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952969    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952972    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952974    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952977    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.032430 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952981    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952984    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952986    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952990    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952992    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952996    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.952999    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953001    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953004    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953007    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953011    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953013    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953016    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953019    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953022    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953025    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953027    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953030    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953033    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953036    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.033311 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953039    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953041    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953044    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953046    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953049    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953052    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953055    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953057    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953060    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953062    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953065    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953068    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953071    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953073    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953076    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953079    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953083    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953085    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953088    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953090    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.035033 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953093    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953095    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953098    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953101    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953103    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953106    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953108    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953112    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953114    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953117    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953119    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953122    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953124    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953126    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953130    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953520    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953525    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953528    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953535    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.035917 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953539    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953542    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953545    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953548    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953551    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953554    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953557    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953559    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953562    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953565    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953568    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953571    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953573    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953576    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953579    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953581    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953585    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953588    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953590    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953593    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.036782 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953595    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953598    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953600    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953603    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953605    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953608    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953610    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953613    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953615    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953618    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953620    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953624    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953627    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953630    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953633    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953635    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953637    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953640    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953643    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953646    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.037651 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953648    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953650    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953653    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953655    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953659    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953662    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953665    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953668    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953670    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953674    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953678    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953681    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953683    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953686    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953689    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953691    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953694    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953696    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953699    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.038524 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953702    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953705    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953707    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953709    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953713    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953716    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953718    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953721    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953724    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953726    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953729    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953731    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953734    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953736    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953739    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953741    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953744    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953748    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953750    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953753    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.039369 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953755    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953758    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953760    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953764    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953766    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953769    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953772    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953774    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953778    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953781    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953783    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953786    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953788    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953791    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953793    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.953796    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953868    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953875    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953882    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953886    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953891    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 02:39:26.040263 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953894    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953899    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953903    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953907    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953910    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953913    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953916    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953919    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953923    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953925    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953928    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953931    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953934    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953939    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953942    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953946    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953949    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953953    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953957    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953961    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953965    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953968    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953972    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953975    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 02:39:26.041334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953978    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953981    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953984    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953990    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953993    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953996    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.953999    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954002    2557 flags.go:64] FLAG: --enable-server="true"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954004    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954009    2557 flags.go:64] FLAG: --event-burst="100"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954012    2557 flags.go:64] FLAG: --event-qps="50"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954015    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954018    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954021    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954024    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954027    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954030    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954033    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954036    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954039    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954042    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954045    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954048    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954051    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954054    2557 flags.go:64] FLAG: --feature-gates=""
Jul 06 02:39:26.042454 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954058    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954061    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954065    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954069    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954072    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954075    2557 flags.go:64] FLAG: --help="false"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954078    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954081    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954084    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954087    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954092    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954096    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954099    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954102    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954105    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954108    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954111    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954114    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954117    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954119    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954122    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954125    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954128    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954131    2557 flags.go:64] FLAG: --lock-file=""
Jul 06 02:39:26.043773 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954133    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954136    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954139    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954145    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954147    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954150    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954153    2557 flags.go:64] FLAG: --logging-format="text"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954156    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954160    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954163    2557 flags.go:64] FLAG: --manifest-url=""
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954167    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954171    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954174    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954178    2557 flags.go:64] FLAG: --max-pods="110"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954181    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954184    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954187    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954190    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954194    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954197    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954200    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954207    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954210    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954213    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 02:39:26.044890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954216    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954219    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954305    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954311    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954317    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954323    2557 flags.go:64] FLAG: --port="10250"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954329    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954333    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025ae2b6726822088"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954337    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954340    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954344    2557 flags.go:64] FLAG: --register-node="true"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954351    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954355    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954358    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954362    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954365    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954369    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954385    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954391    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954543    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954556    2557 flags.go:64] FLAG: --runonce="false"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954563    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954569    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954576    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954582    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 02:39:26.045965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954588    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954593    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954605    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954611    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954616    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954621    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954626    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954631    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954636    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954642    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954647    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954772    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954778    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954783    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954800    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954805    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954810    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954815    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954825    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954835    2557 flags.go:64] FLAG: --v="2"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954853    2557 flags.go:64] FLAG: --version="false"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954860    2557 flags.go:64] FLAG: --vmodule=""
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954866    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.954884    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 02:39:26.047700 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955587    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955599    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955603    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955607    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955610    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955614    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955618    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955621    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955624    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955627    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955630    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955633    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955635    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955638    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955641    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955643    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955646    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955649    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955652    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.048784 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955654    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955657    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955659    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955662    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955665    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955667    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955670    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955677    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955681    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955684    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955686    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955689    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955692    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955695    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955697    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955700    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955703    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955706    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955708    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955711    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.050509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955713    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955716    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955718    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955721    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955731    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955735    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955738    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955741    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955743    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955746    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955748    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955751    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955753    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955756    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955759    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955761    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955764    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955767    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955771    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955773    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.051382 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955776    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955779    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955782    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955785    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955789    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955796    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955799    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955802    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955805    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955808    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955810    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955813    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955816    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955820    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955823    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955827    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955830    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955833    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955835    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.052907 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955838    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955841    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955843    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955846    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955849    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955852    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955855    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955858    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955861    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955863    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955866    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955868    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955871    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955873    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955876    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955878    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955881    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955884    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955888    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955890    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.138302 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.955893    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.956499    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.963162    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.963180    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.963890    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.963900    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963964    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963969    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963973    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963977    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963982    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963985    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963988    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963991    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.139686 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963994    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.963997    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964000    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964004    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964007    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964011    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964014    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964016    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964019    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964022    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964024    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964027    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964030    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964032    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964035    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964039    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964042    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964044    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964047    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964050    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.140951 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964052    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964056    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964058    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964062    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964065    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964067    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964070    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964073    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964075    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964078    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964081    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964083    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964086    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964089    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964091    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964094    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964096    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964099    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964101    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964104    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.142062 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964107    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964111    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964114    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964118    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964121    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964123    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964126    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964129    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964132    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964135    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964137    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964141    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964143    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964146    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964149    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964153    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964156    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964159    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964161    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.143966 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964164    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964182    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964186    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964189    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964192    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964195    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964198    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964200    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964203    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964206    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964209    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964212    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964214    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964217    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964219    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964222    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964225    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964227    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964230    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.144855 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964232    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964236    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964239    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964241    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964244    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964247    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964250    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964252    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964255    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964259    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964262    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964265    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964267    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.964272    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964391    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 02:39:26.145756 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964395    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964398    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964401    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964404    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964406    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964410    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964414    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964416    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964419    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964421    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964424    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964427    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964430    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964432    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964435    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964437    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964440    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964443    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964445    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 02:39:26.146826 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964449    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964452    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964454    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964457    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964460    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964463    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964465    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964488    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964493    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964496    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964498    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964501    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964504    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964507    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964511    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964514    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964517    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964520    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964523    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964526    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 02:39:26.148114 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964529    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964532    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964534    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964537    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964539    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964542    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964544    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964547    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964550    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964553    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964555    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964558    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964561    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964564    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964567    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964569    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964572    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964574    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964577    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964581    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 02:39:26.148968 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964584    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964587    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964589    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964592    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964595    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964597    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964600    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964602    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964605    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964607    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964610    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964613    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964615    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964618    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964621    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964625    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964628    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964631    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964633    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 02:39:26.150262 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964636    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964638    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964641    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964643    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964646    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964650    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964652    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964655    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964658    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964660    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964663    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964665    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964669    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964672    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964674    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964678    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964680    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964683    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964685    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 02:39:26.151143 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:25.964688    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.964693    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.964815    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.969730    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.971087    2557 server.go:1019] "Starting client certificate rotation"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.971190    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.971234    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.973569    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.974966    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.985330    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.988569    2557 log.go:25] "Validated CRI v1 image API"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.989377    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 02:39:26.152451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.992169    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 808285ec-c1ca-4eca-bfc1-b6a15191e46a:/dev/nvme0n1p4 e378eeb0-3f52-4aaf-ad4f-d0fe2fe0bfc4:/dev/nvme0n1p3]
Jul 06 02:39:26.153110 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.992186    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.998403    2557 manager.go:216] Machine: {Timestamp:2026-07-06 02:39:25.996863372 +0000 UTC m=+0.348065686 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095987 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2896b576494cacecdc8370e5417a26 SystemUUID:ec2896b5-7649-4cac-ecdc-8370e5417a26 BootID:d78cd290-a516-4e9a-8b35-478aef36f752 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:ac:0d:d4:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:ac:0d:d4:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:f3:1c:ac:d9:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.998591    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.998695    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.999900    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:25.999927    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.000585    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.000596    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 02:39:26.153962 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.000605    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.001428    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.002609    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.003509    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005326    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005442    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005484    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005494    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005504    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005513    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005522    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005890    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.005906    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.007875    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.010024    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.010069    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011180    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011194    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011200    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011205    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011218    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011233    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011242    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011247    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011253    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011259    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011313    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.011321    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.013915    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.013929    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.015703    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.015760    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.017526    2557 server.go:1268] "Started kubelet"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.017858    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.020600    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.021421    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.021497    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.022988    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.023331    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wzgj"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.026468    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 02:39:26.154409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.026686    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9wzgj"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.027393    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.027460    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.058010    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.058273    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.058590    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.058604    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.060364    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.060728    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.061348    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.061989    2557 factory.go:153] Registering CRI-O factory
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.062005    2557 factory.go:223] Registration of the crio container factory successfully
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066059    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066071    2557 factory.go:55] Registering systemd factory
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066077    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066102    2557 factory.go:103] Registering Raw factory
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066121    2557 manager.go:1196] Started watching for new ooms in manager
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066697    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.066900    2557 manager.go:349] Starting recovery of all containers
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.068808    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.071602    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-33.ec2.internal\" not found" node="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.066792    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-33.ec2.internal.18bf92f6c4707e49  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-33.ec2.internal,UID:ip-10-0-139-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-33.ec2.internal,},FirstTimestamp:2026-07-06 02:39:26.017322569 +0000 UTC m=+0.368524856,LastTimestamp:2026-07-06 02:39:26.017322569 +0000 UTC m=+0.368524856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-33.ec2.internal,}"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.078836    2557 manager.go:354] Recovery completed
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.080440    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.084340    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.086394    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.086422    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.086436    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.087097    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.087108    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.087129    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.088149    2557 policy_none.go:49] "None policy: Start"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.088163    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.088172    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.089033    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.156384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.089374    2557 policy_none.go:47] "Start"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.089939    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.089967    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.089980    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.127862    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.132280    2557 manager.go:337] "Starting Device Plugin manager"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.132317    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.132331    2557 server.go:87] "Starting device plugin registration server"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.132662    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.132674    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.133067    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.133129    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.133135    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.135299    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 02:39:26.157893 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.135350    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.223688    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.223738    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.223762    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.223803    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.225988    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.233743    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.238763    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.238786    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.238795    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.238818    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.244324    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.244343    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-33.ec2.internal\": node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.300502 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.257798    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.324388    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"]
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.324534    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.325638    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.325671    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.325682    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327140    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327254    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327294    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327936    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327965    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327976    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.327917    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.328351    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.328361    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.329473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.329502    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.330256    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.330278    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.330291    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeHasSufficientPID"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.353215    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-33.ec2.internal\" not found" node="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.357524    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-33.ec2.internal\" not found" node="ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.358534    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.361491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5adcc9393bdc45ff5e4e17d808ba5066-config\") pod \"kube-apiserver-proxy-ip-10-0-139-33.ec2.internal\" (UID: \"5adcc9393bdc45ff5e4e17d808ba5066\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.361515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.421679 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.361561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.460536    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5adcc9393bdc45ff5e4e17d808ba5066-config\") pod \"kube-apiserver-proxy-ip-10-0-139-33.ec2.internal\" (UID: \"5adcc9393bdc45ff5e4e17d808ba5066\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462578    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5adcc9393bdc45ff5e4e17d808ba5066-config\") pod \"kube-apiserver-proxy-ip-10-0-139-33.ec2.internal\" (UID: \"5adcc9393bdc45ff5e4e17d808ba5066\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462596    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.550684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.462663    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a576817132bdedc63b7258acac9b28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal\" (UID: \"a5a576817132bdedc63b7258acac9b28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.695638 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.562142    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.695638 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.657789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.695638 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.660580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.695638 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.663042    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.795888 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.764171    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.937517 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:26.865564    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-33.ec2.internal\" not found"
Jul 06 02:39:26.937517 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.865934    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:26.937517 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.928574    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.940054 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.939878    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 02:39:26.941810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.941795    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal"
Jul 06 02:39:26.947616 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.947574    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 02:39:26.974577 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.974559    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 02:39:26.974685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.974670    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 02:39:26.974734 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.974692    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 02:39:26.974734 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:26.974720    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 02:39:27.007554 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.007535    2557 apiserver.go:52] "Watching apiserver"
Jul 06 02:39:27.030284 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.030266    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 02:39:27.033136 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.033119    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 02:39:27.034462 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.034425    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-556lk","openshift-network-diagnostics/network-check-target-q2v6m","openshift-network-operator/iptables-alerter-nxq27","openshift-ovn-kubernetes/ovnkube-node-kcglm","kube-system/konnectivity-agent-pgsjn","kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9","openshift-cluster-node-tuning-operator/tuned-7z4dn","openshift-image-registry/node-ca-2sx67","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal","openshift-multus/multus-additional-cni-plugins-95fkk","openshift-multus/multus-qf2dv","kube-system/global-pull-secret-syncer-tctwn","openshift-dns/node-resolver-bnb6s"]
Jul 06 02:39:27.035821 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.035808    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.036899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.036877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.036986 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.036945    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:27.037915 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.037900    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.038190 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.038162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.038364 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.038346    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.038417 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.038403    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 02:39:27.038448 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.038418    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s8pz\""
Jul 06 02:39:27.039239 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.039224    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.039877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.039852    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.040876 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.040856    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.041052 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041032    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 02:39:27.041135 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041036    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g77bq\""
Jul 06 02:39:27.041135 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.041239 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041219    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 02:39:27.041569 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041555    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 02:39:27.041646 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.041646 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041627    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 02:39:27.041745 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041664    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.041745 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041574    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 02:39:27.041819 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041806    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 02:39:27.041898 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041883    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xq2dl\""
Jul 06 02:39:27.041950 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.041941    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.044467 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.043005    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k78gp\""
Jul 06 02:39:27.044467 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.044368    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 02:39:27.044467 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.044383    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 02:39:27.044823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.044801    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.045147 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.045128    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.045210 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.045166    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ht6cl\""
Jul 06 02:39:27.045431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.045416    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.046733 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.046713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.046804 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.046786    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:27.047564 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.047540    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 02:39:27.047655 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.047604    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2dwl6\""
Jul 06 02:39:27.047737 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.047681    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.047737 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.047724    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.048287 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.048267    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:27.048376 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.048326    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:27.049639 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.049619    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.051200 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.050922    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.051711 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.051689    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.051786 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.051741    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.051786 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.051754    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2b5fx\""
Jul 06 02:39:27.052360 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.052337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.053146 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053127    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 02:39:27.053229 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053196    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 02:39:27.053578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053556    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 02:39:27.053666 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053576    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 02:39:27.053725 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053692    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2xstb\""
Jul 06 02:39:27.053807 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.053792    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 02:39:27.054401 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.054387    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x8rxk\""
Jul 06 02:39:27.054495 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.054479    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 02:39:27.061216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.061201    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 02:39:27.061314 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.061283    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 02:34:26 +0000 UTC" deadline="2028-03-22 21:49:16.60377099 +0000 UTC"
Jul 06 02:39:27.061349 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.061314    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15019h9m49.542458895s"
Jul 06 02:39:27.066303 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066283    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.066398 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-netns\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.066398 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-run\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-log-socket\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6t8n\" (UniqueName: \"kubernetes.io/projected/72bacfad-daba-42f9-96c2-eb4240b700a2-kube-api-access-v6t8n\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-cnibin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56tbh\" (UniqueName: \"kubernetes.io/projected/76e67a7e-cc97-497a-bb9b-88edbc098883-kube-api-access-56tbh\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a77db565-5a39-40ba-9d6e-2d2247275ff3-iptables-alerter-script\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.066624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rl6m\" (UniqueName: \"kubernetes.io/projected/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-kube-api-access-5rl6m\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066713    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-socket-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-sys-fs\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-cni-binary-copy\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnjl\" (UniqueName: \"kubernetes.io/projected/ec75722e-44fb-4444-a909-230de918c211-kube-api-access-qqnjl\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-host\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-tmp\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-kubelet\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-config\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.066974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-kubelet\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.066981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-sys\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067011    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-kubelet-config\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067065    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082228-58e2-4d40-8743-07183c62fe27-tmp-dir\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-systemd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-tuned\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-device-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-systemd-units\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-var-lib-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067390    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvfv6"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-system-cni-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cnibin\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a77db565-5a39-40ba-9d6e-2d2247275ff3-host-slash\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-etc-kubernetes\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-kubernetes\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-registration-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25a848ae-3077-469d-9d02-81f8a32e6503-ovn-node-metrics-cert\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tp4d\" (UniqueName: \"kubernetes.io/projected/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-kube-api-access-5tp4d\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-k8s-cni-cncf-io\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.067983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-bin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-daemon-config\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-var-lib-kubelet\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysconfig\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-systemd\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-lib-modules\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d6m5\" (UniqueName: \"kubernetes.io/projected/25a848ae-3077-469d-9d02-81f8a32e6503-kube-api-access-2d6m5\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-etc-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/767ebcbc-221d-4250-973e-f659627967dc-agent-certs\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067973    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-os-release\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.067996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-system-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-os-release\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-socket-dir-parent\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-conf-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-multus-certs\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-node-log\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-conf\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-netns\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-ovn\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/767ebcbc-221d-4250-973e-f659627967dc-konnectivity-ca\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47bzp\" (UniqueName: \"kubernetes.io/projected/a77db565-5a39-40ba-9d6e-2d2247275ff3-kube-api-access-47bzp\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26082228-58e2-4d40-8743-07183c62fe27-hosts-file\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-modprobe-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q8h5\" (UniqueName: \"kubernetes.io/projected/30f9990d-57c2-4061-9fe7-381e126c97e5-kube-api-access-8q8h5\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-dbus\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-bin\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-env-overrides\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.068895 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-script-lib\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnsf7\" (UniqueName: \"kubernetes.io/projected/26082228-58e2-4d40-8743-07183c62fe27-kube-api-access-gnsf7\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-host\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-serviceca\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-multus\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-hostroot\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-slash\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.069342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.068636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-netd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.075083 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.075063    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvfv6"
Jul 06 02:39:27.169783 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a77db565-5a39-40ba-9d6e-2d2247275ff3-host-slash\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-etc-kubernetes\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-kubernetes\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-registration-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169856    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a77db565-5a39-40ba-9d6e-2d2247275ff3-host-slash\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.169937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-registration-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-kubernetes\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169945    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169962    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-etc-kubernetes\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.169968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170010    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25a848ae-3077-469d-9d02-81f8a32e6503-ovn-node-metrics-cert\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tp4d\" (UniqueName: \"kubernetes.io/projected/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-kube-api-access-5tp4d\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170121    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-k8s-cni-cncf-io\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-bin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-daemon-config\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170171    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-var-lib-kubelet\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysconfig\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170208    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-k8s-cni-cncf-io\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170225 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170215    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-systemd\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-lib-modules\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170264    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-systemd\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170262    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-var-lib-kubelet\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d6m5\" (UniqueName: \"kubernetes.io/projected/25a848ae-3077-469d-9d02-81f8a32e6503-kube-api-access-2d6m5\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysconfig\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-etc-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/767ebcbc-221d-4250-973e-f659627967dc-agent-certs\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170383    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-os-release\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-lib-modules\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-system-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170424    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-os-release\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170465    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-system-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-socket-dir-parent\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.170952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170355    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-etc-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-conf-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-multus-certs\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170541    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-os-release\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-node-log\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-conf\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170659    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-conf-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170666    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-socket-dir-parent\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170711    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-multus-certs\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170733    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-os-release\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170315    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-bin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170750    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-conf\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170757    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-node-log\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-netns\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170803    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-ovn\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.171796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/767ebcbc-221d-4250-973e-f659627967dc-konnectivity-ca\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47bzp\" (UniqueName: \"kubernetes.io/projected/a77db565-5a39-40ba-9d6e-2d2247275ff3-kube-api-access-47bzp\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170864    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-netns\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170906    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-daemon-config\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.170906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171160    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-ovn\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26082228-58e2-4d40-8743-07183c62fe27-hosts-file\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-modprobe-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171246    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q8h5\" (UniqueName: \"kubernetes.io/projected/30f9990d-57c2-4061-9fe7-381e126c97e5-kube-api-access-8q8h5\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-dbus\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-bin\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-env-overrides\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171360    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-modprobe-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-script-lib\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.172544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171377    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/767ebcbc-221d-4250-973e-f659627967dc-konnectivity-ca\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171418    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26082228-58e2-4d40-8743-07183c62fe27-hosts-file\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnsf7\" (UniqueName: \"kubernetes.io/projected/26082228-58e2-4d40-8743-07183c62fe27-kube-api-access-gnsf7\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-host\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-serviceca\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-multus\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-hostroot\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-slash\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171619    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171642    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-netd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-netns\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-run\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.173320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171740    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-dbus\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171442    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-bin\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-log-socket\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171804    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-host\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6t8n\" (UniqueName: \"kubernetes.io/projected/72bacfad-daba-42f9-96c2-eb4240b700a2-kube-api-access-v6t8n\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-cnibin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171865    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-multus-cni-dir\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56tbh\" (UniqueName: \"kubernetes.io/projected/76e67a7e-cc97-497a-bb9b-88edbc098883-kube-api-access-56tbh\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171913    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-cni-multus\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a77db565-5a39-40ba-9d6e-2d2247275ff3-iptables-alerter-script\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-run\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171941    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rl6m\" (UniqueName: \"kubernetes.io/projected/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-kube-api-access-5rl6m\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:27.174095 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172008    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-socket-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172053    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-sysctl-d\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172063    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-sys-fs\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-cni-binary-copy\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172101    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-cni-netd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.171959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-hostroot\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnjl\" (UniqueName: \"kubernetes.io/projected/ec75722e-44fb-4444-a909-230de918c211-kube-api-access-qqnjl\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172161    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-log-socket\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-host\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172199    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-tmp\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-kubelet\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-config\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-kubelet\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-sys\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.174832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-kubelet-config\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-serviceca\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082228-58e2-4d40-8743-07183c62fe27-tmp-dir\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172456    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-run-netns\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172506    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-slash\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172535    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-script-lib\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172611    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-systemd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-tuned\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172718    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-device-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.175587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-systemd-units\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-var-lib-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172785    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172228    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-cnibin\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172800    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-kubelet\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172873    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172923    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-socket-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172934    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-system-cni-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172988    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-sys-fs\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173033    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-run-systemd\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173292    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-ovnkube-config\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173358    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e67a7e-cc97-497a-bb9b-88edbc098883-host-var-lib-kubelet\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173416    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-sys\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173469    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-kubelet-config\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173515    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-host-run-ovn-kubernetes\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173525    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e67a7e-cc97-497a-bb9b-88edbc098883-cni-binary-copy\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173671    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173824    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30f9990d-57c2-4061-9fe7-381e126c97e5-host\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26082228-58e2-4d40-8743-07183c62fe27-tmp-dir\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.173976    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25a848ae-3077-469d-9d02-81f8a32e6503-ovn-node-metrics-cert\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.172801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-system-cni-dir\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cnibin\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174109    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/767ebcbc-221d-4250-973e-f659627967dc-agent-certs\") pod \"konnectivity-agent-pgsjn\" (UID: \"767ebcbc-221d-4250-973e-f659627967dc\") " pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.174115    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174163    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cnibin\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.174227    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:27.67419266 +0000 UTC m=+2.025394954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174459    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72bacfad-daba-42f9-96c2-eb4240b700a2-device-dir\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174512    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-systemd-units\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.176494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174522    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174580    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25a848ae-3077-469d-9d02-81f8a32e6503-var-lib-openvswitch\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25a848ae-3077-469d-9d02-81f8a32e6503-env-overrides\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.174614    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.174707    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:27.674687602 +0000 UTC m=+2.025889887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.174808    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a77db565-5a39-40ba-9d6e-2d2247275ff3-iptables-alerter-script\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.175409    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-etc-tuned\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.177004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.176699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f9990d-57c2-4061-9fe7-381e126c97e5-tmp\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.179763 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.179742    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:27.179763 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.179766    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:27.179940 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.179779    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:27.179940 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.179832    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:27.679814203 +0000 UTC m=+2.031016482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:27.180692 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.180632    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d6m5\" (UniqueName: \"kubernetes.io/projected/25a848ae-3077-469d-9d02-81f8a32e6503-kube-api-access-2d6m5\") pod \"ovnkube-node-kcglm\" (UID: \"25a848ae-3077-469d-9d02-81f8a32e6503\") " pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.181748 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.181723    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tp4d\" (UniqueName: \"kubernetes.io/projected/a7eadb9a-e575-408d-8996-4bcef2d6e3b7-kube-api-access-5tp4d\") pod \"multus-additional-cni-plugins-95fkk\" (UID: \"a7eadb9a-e575-408d-8996-4bcef2d6e3b7\") " pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.182665 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.182639    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnsf7\" (UniqueName: \"kubernetes.io/projected/26082228-58e2-4d40-8743-07183c62fe27-kube-api-access-gnsf7\") pod \"node-resolver-bnb6s\" (UID: \"26082228-58e2-4d40-8743-07183c62fe27\") " pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.183260 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.183212    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6t8n\" (UniqueName: \"kubernetes.io/projected/72bacfad-daba-42f9-96c2-eb4240b700a2-kube-api-access-v6t8n\") pod \"aws-ebs-csi-driver-node-dlgk9\" (UID: \"72bacfad-daba-42f9-96c2-eb4240b700a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.183734 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.183712    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rl6m\" (UniqueName: \"kubernetes.io/projected/ea3397fd-652a-4fd4-a5b3-dc7672131a5a-kube-api-access-5rl6m\") pod \"node-ca-2sx67\" (UID: \"ea3397fd-652a-4fd4-a5b3-dc7672131a5a\") " pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.183805 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.183718    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56tbh\" (UniqueName: \"kubernetes.io/projected/76e67a7e-cc97-497a-bb9b-88edbc098883-kube-api-access-56tbh\") pod \"multus-qf2dv\" (UID: \"76e67a7e-cc97-497a-bb9b-88edbc098883\") " pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.184037 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.184021    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnjl\" (UniqueName: \"kubernetes.io/projected/ec75722e-44fb-4444-a909-230de918c211-kube-api-access-qqnjl\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.184775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.184752    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47bzp\" (UniqueName: \"kubernetes.io/projected/a77db565-5a39-40ba-9d6e-2d2247275ff3-kube-api-access-47bzp\") pod \"iptables-alerter-nxq27\" (UID: \"a77db565-5a39-40ba-9d6e-2d2247275ff3\") " pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.185434 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.185414    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q8h5\" (UniqueName: \"kubernetes.io/projected/30f9990d-57c2-4061-9fe7-381e126c97e5-kube-api-access-8q8h5\") pod \"tuned-7z4dn\" (UID: \"30f9990d-57c2-4061-9fe7-381e126c97e5\") " pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.200501 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.200441    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:27.203873 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.203849    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95fkk"
Jul 06 02:39:27.208829 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.208813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qf2dv"
Jul 06 02:39:27.283095 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.283058    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5adcc9393bdc45ff5e4e17d808ba5066.slice/crio-67fc973a096adf6be8ca86ed50dce4dcb24ca6ffb7537b5227f13566e648b691 WatchSource:0}: Error finding container 67fc973a096adf6be8ca86ed50dce4dcb24ca6ffb7537b5227f13566e648b691: Status 404 returned error can't find the container with id 67fc973a096adf6be8ca86ed50dce4dcb24ca6ffb7537b5227f13566e648b691
Jul 06 02:39:27.285224 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.285201    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a576817132bdedc63b7258acac9b28.slice/crio-1ce29cf5516327d00181e77e1c509b602e706ab5b87a089f838694cb39ce9222 WatchSource:0}: Error finding container 1ce29cf5516327d00181e77e1c509b602e706ab5b87a089f838694cb39ce9222: Status 404 returned error can't find the container with id 1ce29cf5516327d00181e77e1c509b602e706ab5b87a089f838694cb39ce9222
Jul 06 02:39:27.288470 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.288454    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:39:27.356892 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.356872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9"
Jul 06 02:39:27.366883 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.366856    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bacfad_daba_42f9_96c2_eb4240b700a2.slice/crio-127c16b6047c9501c73eff48e616f592a78da9331e74445337ff529bc737dbf6 WatchSource:0}: Error finding container 127c16b6047c9501c73eff48e616f592a78da9331e74445337ff529bc737dbf6: Status 404 returned error can't find the container with id 127c16b6047c9501c73eff48e616f592a78da9331e74445337ff529bc737dbf6
Jul 06 02:39:27.393607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.393587    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nxq27"
Jul 06 02:39:27.401932 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.401911    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77db565_5a39_40ba_9d6e_2d2247275ff3.slice/crio-6d87752e2a10921b50ab95df12e5a841e97e8a6b893365c6bcc6903084469c60 WatchSource:0}: Error finding container 6d87752e2a10921b50ab95df12e5a841e97e8a6b893365c6bcc6903084469c60: Status 404 returned error can't find the container with id 6d87752e2a10921b50ab95df12e5a841e97e8a6b893365c6bcc6903084469c60
Jul 06 02:39:27.413038 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.413021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:27.423232 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.423211    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a848ae_3077_469d_9d02_81f8a32e6503.slice/crio-9141fb108f303a1d53ae18dbece00e234e02626973055b4c2a8f0594e63ace4a WatchSource:0}: Error finding container 9141fb108f303a1d53ae18dbece00e234e02626973055b4c2a8f0594e63ace4a: Status 404 returned error can't find the container with id 9141fb108f303a1d53ae18dbece00e234e02626973055b4c2a8f0594e63ace4a
Jul 06 02:39:27.424128 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.424104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:27.432210 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.432190    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767ebcbc_221d_4250_973e_f659627967dc.slice/crio-53007bc36afc8f4d7d23145e414ccff08c5c4ca15bc6498dc8011a170a946450 WatchSource:0}: Error finding container 53007bc36afc8f4d7d23145e414ccff08c5c4ca15bc6498dc8011a170a946450: Status 404 returned error can't find the container with id 53007bc36afc8f4d7d23145e414ccff08c5c4ca15bc6498dc8011a170a946450
Jul 06 02:39:27.440736 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.440721    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bnb6s"
Jul 06 02:39:27.448932 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.448914    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26082228_58e2_4d40_8743_07183c62fe27.slice/crio-f040fc806cf0acb9b9c76648f5fa858dea2dcc9e250bb33c6497c30add8a3c34 WatchSource:0}: Error finding container f040fc806cf0acb9b9c76648f5fa858dea2dcc9e250bb33c6497c30add8a3c34: Status 404 returned error can't find the container with id f040fc806cf0acb9b9c76648f5fa858dea2dcc9e250bb33c6497c30add8a3c34
Jul 06 02:39:27.458904 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.458887    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2sx67"
Jul 06 02:39:27.467365 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.467343    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3397fd_652a_4fd4_a5b3_dc7672131a5a.slice/crio-f1951fc88ebe08fb9eef7c16cdbf4717eac9b4a633b7cb342ba2c9a472a1fa4b WatchSource:0}: Error finding container f1951fc88ebe08fb9eef7c16cdbf4717eac9b4a633b7cb342ba2c9a472a1fa4b: Status 404 returned error can't find the container with id f1951fc88ebe08fb9eef7c16cdbf4717eac9b4a633b7cb342ba2c9a472a1fa4b
Jul 06 02:39:27.475718 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.475702    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7z4dn"
Jul 06 02:39:27.483259 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.483239    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f9990d_57c2_4061_9fe7_381e126c97e5.slice/crio-d60bf622b06a19f7cf8e5161387370beed5f70b4c3e589c38de17fdb7c97253e WatchSource:0}: Error finding container d60bf622b06a19f7cf8e5161387370beed5f70b4c3e589c38de17fdb7c97253e: Status 404 returned error can't find the container with id d60bf622b06a19f7cf8e5161387370beed5f70b4c3e589c38de17fdb7c97253e
Jul 06 02:39:27.545932 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.545902    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7eadb9a_e575_408d_8996_4bcef2d6e3b7.slice/crio-e7314f1c7a92cb9e8995ce537eb402d5b93a9f0338c3e9961dc377c0adff6711 WatchSource:0}: Error finding container e7314f1c7a92cb9e8995ce537eb402d5b93a9f0338c3e9961dc377c0adff6711: Status 404 returned error can't find the container with id e7314f1c7a92cb9e8995ce537eb402d5b93a9f0338c3e9961dc377c0adff6711
Jul 06 02:39:27.617365 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:39:27.617343    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e67a7e_cc97_497a_bb9b_88edbc098883.slice/crio-4fc6ca97b7531968a5af1dadec67a7774489ad8dd27b2b5cfc5ced51bd1cccf8 WatchSource:0}: Error finding container 4fc6ca97b7531968a5af1dadec67a7774489ad8dd27b2b5cfc5ced51bd1cccf8: Status 404 returned error can't find the container with id 4fc6ca97b7531968a5af1dadec67a7774489ad8dd27b2b5cfc5ced51bd1cccf8
Jul 06 02:39:27.677879 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.677848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:27.677965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.677884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:27.678025 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.678010    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:27.678074 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.678066    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:28.67805167 +0000 UTC m=+3.029253946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:27.678118 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.678010    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:27.678157 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.678146    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:28.678133774 +0000 UTC m=+3.029336063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:27.779277 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.779200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:27.779429 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.779406    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:27.779526 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.779436    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:27.779526 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.779451    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:27.779643 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:27.779535    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:28.779497452 +0000 UTC m=+3.130699735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:27.995685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:27.995649    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:28.077327 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.077153    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 02:34:27 +0000 UTC" deadline="2028-03-12 23:58:17.670384476 +0000 UTC"
Jul 06 02:39:28.077327 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.077222    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14781h18m49.59316664s"
Jul 06 02:39:28.225723 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.225693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:28.225723 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.225736    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:28.225984 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.225842    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:28.226051 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.225991    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:28.255946 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.255876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qf2dv" event={"ID":"76e67a7e-cc97-497a-bb9b-88edbc098883","Type":"ContainerStarted","Data":"4fc6ca97b7531968a5af1dadec67a7774489ad8dd27b2b5cfc5ced51bd1cccf8"}
Jul 06 02:39:28.271014 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.270932    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerStarted","Data":"e7314f1c7a92cb9e8995ce537eb402d5b93a9f0338c3e9961dc377c0adff6711"}
Jul 06 02:39:28.285865 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.285835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7z4dn" event={"ID":"30f9990d-57c2-4061-9fe7-381e126c97e5","Type":"ContainerStarted","Data":"d60bf622b06a19f7cf8e5161387370beed5f70b4c3e589c38de17fdb7c97253e"}
Jul 06 02:39:28.294868 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.294623    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnb6s" event={"ID":"26082228-58e2-4d40-8743-07183c62fe27","Type":"ContainerStarted","Data":"f040fc806cf0acb9b9c76648f5fa858dea2dcc9e250bb33c6497c30add8a3c34"}
Jul 06 02:39:28.304142 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.304113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal" event={"ID":"a5a576817132bdedc63b7258acac9b28","Type":"ContainerStarted","Data":"1ce29cf5516327d00181e77e1c509b602e706ab5b87a089f838694cb39ce9222"}
Jul 06 02:39:28.312565 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.307915    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sx67" event={"ID":"ea3397fd-652a-4fd4-a5b3-dc7672131a5a","Type":"ContainerStarted","Data":"f1951fc88ebe08fb9eef7c16cdbf4717eac9b4a633b7cb342ba2c9a472a1fa4b"}
Jul 06 02:39:28.323148 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.322648    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgsjn" event={"ID":"767ebcbc-221d-4250-973e-f659627967dc","Type":"ContainerStarted","Data":"53007bc36afc8f4d7d23145e414ccff08c5c4ca15bc6498dc8011a170a946450"}
Jul 06 02:39:28.358873 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.357674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"9141fb108f303a1d53ae18dbece00e234e02626973055b4c2a8f0594e63ace4a"}
Jul 06 02:39:28.383398 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.383364    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxq27" event={"ID":"a77db565-5a39-40ba-9d6e-2d2247275ff3","Type":"ContainerStarted","Data":"6d87752e2a10921b50ab95df12e5a841e97e8a6b893365c6bcc6903084469c60"}
Jul 06 02:39:28.397570 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.397474    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9" event={"ID":"72bacfad-daba-42f9-96c2-eb4240b700a2","Type":"ContainerStarted","Data":"127c16b6047c9501c73eff48e616f592a78da9331e74445337ff529bc737dbf6"}
Jul 06 02:39:28.421235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.421200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal" event={"ID":"5adcc9393bdc45ff5e4e17d808ba5066","Type":"ContainerStarted","Data":"67fc973a096adf6be8ca86ed50dce4dcb24ca6ffb7537b5227f13566e648b691"}
Jul 06 02:39:28.458565 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.458339    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:28.688993 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.688861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:28.688993 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.688911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:28.689230 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.689105    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:28.689230 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.689166    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:30.689147151 +0000 UTC m=+5.040349429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:28.689642 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.689616    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:28.689903 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.689676    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:30.689658881 +0000 UTC m=+5.040861161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:28.791790 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:28.790135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:28.791790 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.790393    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:28.791790 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.790416    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:28.791790 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.790429    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:28.791790 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:28.790486    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:30.79046657 +0000 UTC m=+5.141668849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:29.077934 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:29.077786    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 02:34:27 +0000 UTC" deadline="2027-12-14 06:18:08.17566002 +0000 UTC"
Jul 06 02:39:29.077934 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:29.077849    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12627h38m39.097815698s"
Jul 06 02:39:29.225331 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:29.224792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:29.225331 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:29.224923    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:29.611031 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:29.610773    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 02:39:30.225676 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:30.225642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:30.226173 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.225793    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:30.226244 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:30.226221    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:30.226388 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.226316    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:30.707420 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:30.707380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:30.707621 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:30.707435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:30.707621 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.707596    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:30.707762 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.707664    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:34.707643934 +0000 UTC m=+9.058846215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:30.708103 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.708083    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:30.708193 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.708138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:34.708119651 +0000 UTC m=+9.059321927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:30.808566 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:30.807987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:30.808566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.808169    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:30.808566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.808187    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:30.808566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.808199    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:30.808566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:30.808255    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:34.808236771 +0000 UTC m=+9.159439050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:31.225256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:31.224796    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:31.225256 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:31.224912    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:32.225684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:32.225616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:32.226268 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:32.225755    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:32.226268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:32.225623    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:32.226268 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:32.226181    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:33.224367 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:33.224332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:33.224601 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:33.224464    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:34.225514 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:34.224953    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:34.225514 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.225096    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:34.225514 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:34.224970    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:34.225514 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.225268    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:34.740117 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:34.740073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:34.740117 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:34.740117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:34.740361 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.740292    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:34.740361 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.740348    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:42.740330801 +0000 UTC m=+17.091533087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:34.740817 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.740736    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:34.740817 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.740789    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:42.740771649 +0000 UTC m=+17.091973927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:34.841074 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:34.841040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:34.841260 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.841184    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:34.841260 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.841205    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:34.841260 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.841217    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:34.841401 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:34.841279    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:42.84126094 +0000 UTC m=+17.192463219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:35.224280 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:35.224246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:35.224458 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:35.224365    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:36.225835 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:36.225730    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:36.226293 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:36.225883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:36.226293 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:36.225916    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:36.226293 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:36.225958    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:37.224640 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:37.224604    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:37.224834 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:37.224732    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:38.224387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:38.224350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:38.224850 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:38.224360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:38.224850 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:38.224511    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:38.224850 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:38.224577    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:39.224988 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:39.224920    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:39.225374 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:39.225026    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:40.224561 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:40.224525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:40.224743 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:40.224657    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:40.224743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:40.224719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:40.224877 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:40.224854    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:41.224489 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:41.224451    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:41.224938 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:41.224590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:42.224775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:42.224736    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:42.225220 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.224887    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:42.225220 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:42.224948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:42.225220 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.225069    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:42.799671 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:42.799641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:42.799825 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:42.799675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:42.799825 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.799796    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:42.799891 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.799845    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:58.799832729 +0000 UTC m=+33.151035015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:42.799891 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.799796    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:42.799999 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.799921    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:58.799908863 +0000 UTC m=+33.151111152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:42.900664 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:42.900634    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:42.900828 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.900792    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:42.900828 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.900819    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:42.900945 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.900832    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:42.900945 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:42.900893    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:39:58.9008745 +0000 UTC m=+33.252076774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:43.224617 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:43.224582    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:43.224826 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:43.224713    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:44.224602 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:44.224564    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:44.224860 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:44.224691    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:44.224860 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:44.224750    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:44.224860 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:44.224833    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:45.224404 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:45.224369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:45.224600 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:45.224492    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:46.225131 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:46.225099    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:46.225597 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:46.225156    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:46.225597 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:46.225231    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:46.225597 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:46.225344    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:47.224482 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:47.224425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:47.224605 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:47.224554    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:48.225123 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.224715    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:48.225670 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.224763    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:48.225670 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:48.225254    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:48.225670 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:48.225358    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:48.461256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.461184    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9" event={"ID":"72bacfad-daba-42f9-96c2-eb4240b700a2","Type":"ContainerStarted","Data":"3ad8488283976c87a049b26016aba70971cd5e412164ceefdd7e2c49e44d1411"}
Jul 06 02:39:48.462903 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.462871    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal" event={"ID":"5adcc9393bdc45ff5e4e17d808ba5066","Type":"ContainerStarted","Data":"ba0d483f9c49492b45fd721cdc22bd2e41687ac33408182e68afe14d13f3b3d9"}
Jul 06 02:39:48.464226 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.464198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qf2dv" event={"ID":"76e67a7e-cc97-497a-bb9b-88edbc098883","Type":"ContainerStarted","Data":"71d314fb37d3537aa311535f42d339cbcd626448ae12320a7ce42bf9b1dab592"}
Jul 06 02:39:48.465691 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.465664    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="0eff8173b579db6672b371ad17017a774ee351bb2bf24373fa99e2387869238d" exitCode=0
Jul 06 02:39:48.465784 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.465700    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"0eff8173b579db6672b371ad17017a774ee351bb2bf24373fa99e2387869238d"}
Jul 06 02:39:48.467130 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.467112    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7z4dn" event={"ID":"30f9990d-57c2-4061-9fe7-381e126c97e5","Type":"ContainerStarted","Data":"ea0b0211a51e9236b23ba6459bafa39020417efb404599f89df9dd172967d5fb"}
Jul 06 02:39:48.468514 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.468493    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bnb6s" event={"ID":"26082228-58e2-4d40-8743-07183c62fe27","Type":"ContainerStarted","Data":"77b7d29de8061c219a8737c0fe881d197a3a2812bc3a38ef63a87e476668768e"}
Jul 06 02:39:48.469830 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.469810    2557 generic.go:356] "Generic (PLEG): container finished" podID="a5a576817132bdedc63b7258acac9b28" containerID="a8f5e2a0c753766e03641403f1cadd72ed528935672cc20632e8b6f4f3fd1e02" exitCode=0
Jul 06 02:39:48.469950 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.469886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal" event={"ID":"a5a576817132bdedc63b7258acac9b28","Type":"ContainerDied","Data":"a8f5e2a0c753766e03641403f1cadd72ed528935672cc20632e8b6f4f3fd1e02"}
Jul 06 02:39:48.471394 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.471369    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2sx67" event={"ID":"ea3397fd-652a-4fd4-a5b3-dc7672131a5a","Type":"ContainerStarted","Data":"4e6f486900548f194bc56d166905bd605c2034ea11a78eb2b2b78ac00f6a2d32"}
Jul 06 02:39:48.472751 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.472731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgsjn" event={"ID":"767ebcbc-221d-4250-973e-f659627967dc","Type":"ContainerStarted","Data":"18a6dd6f7b958eff8a08cdafc8e3ae27b5176b825c542d57cc8045d0e306469e"}
Jul 06 02:39:48.475466 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"57f33c4481d798038b669180da27c6714dbbc5f44d8c453393db7194c5b8531e"}
Jul 06 02:39:48.475557 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"35887d8d42b29e92eec18d19eb7716ba8358412ee31e1cd6491c581917561687"}
Jul 06 02:39:48.475557 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"529c35989b37c102d8a0b289564dd6de2276b0b83f24c2d547a9ec6ee2ef40a5"}
Jul 06 02:39:48.475626 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"9c3d8dd6d6022409f1aa97c940555f3f9201b142649ea3e72e60b1f23b5e2c25"}
Jul 06 02:39:48.475626 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"d9932f240d4b3694977631dcbd9c535a22cd36a9c09255fcc1cf0e52982e2dcd"}
Jul 06 02:39:48.475685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"d1a40267880ac3a71290f8d3720950cdf50595dba168d304808603fd27b06387"}
Jul 06 02:39:48.475772 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.475731    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-33.ec2.internal" podStartSLOduration=21.475718586 podStartE2EDuration="21.475718586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.475217989 +0000 UTC m=+22.826420285" watchObservedRunningTime="2026-07-06 02:39:48.475718586 +0000 UTC m=+22.826920882"
Jul 06 02:39:48.489353 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.489323    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qf2dv" podStartSLOduration=2.723313564 podStartE2EDuration="22.489312588s" totalImagesPullingTime="19.765999024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.48902486 +0000 UTC m=+22.840227155" watchObservedRunningTime="2026-07-06 02:39:48.489312588 +0000 UTC m=+22.840514883"
Jul 06 02:39:48.527387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.527347    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bnb6s" podStartSLOduration=2.605046591 podStartE2EDuration="22.527330426s" totalImagesPullingTime="19.922283835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.527043516 +0000 UTC m=+22.878245842" watchObservedRunningTime="2026-07-06 02:39:48.527330426 +0000 UTC m=+22.878532723"
Jul 06 02:39:48.527712 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.527684    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pgsjn" podStartSLOduration=2.5884889749999997 podStartE2EDuration="22.527674245s" totalImagesPullingTime="19.93918527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.514932367 +0000 UTC m=+22.866134688" watchObservedRunningTime="2026-07-06 02:39:48.527674245 +0000 UTC m=+22.878876541"
Jul 06 02:39:48.540963 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.540917    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2sx67" podStartSLOduration=2.6369871419999997 podStartE2EDuration="22.540900624s" totalImagesPullingTime="19.903913482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.540352616 +0000 UTC m=+22.891554912" watchObservedRunningTime="2026-07-06 02:39:48.540900624 +0000 UTC m=+22.892102921"
Jul 06 02:39:48.555617 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:48.555452    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7z4dn" podStartSLOduration=2.666167487 podStartE2EDuration="22.555438551s" totalImagesPullingTime="19.889271064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:48.555196177 +0000 UTC m=+22.906398472" watchObservedRunningTime="2026-07-06 02:39:48.555438551 +0000 UTC m=+22.906640847"
Jul 06 02:39:49.224942 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:49.224902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:49.225263 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:49.225029    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:49.479347 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:49.479270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal" event={"ID":"a5a576817132bdedc63b7258acac9b28","Type":"ContainerStarted","Data":"85331ef71433399fd1ef5dbd406f059cfbdbbd91cfa37b27e6f57afc81642f1c"}
Jul 06 02:39:49.480861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:49.480837    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nxq27" event={"ID":"a77db565-5a39-40ba-9d6e-2d2247275ff3","Type":"ContainerStarted","Data":"13a5d7cba4b13a5eb9c927ce256ae3277660cefda86d65528b6ae70b36edba6c"}
Jul 06 02:39:49.493714 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:49.493655    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-33.ec2.internal" podStartSLOduration=22.493592424 podStartE2EDuration="22.493592424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:49.492800994 +0000 UTC m=+23.844003291" watchObservedRunningTime="2026-07-06 02:39:49.493592424 +0000 UTC m=+23.844794711"
Jul 06 02:39:49.535920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:49.535890    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 02:39:50.148868 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.148714    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T02:39:49.535908328Z","UUID":"d855c3dc-7be8-4e25-8d19-9a03714384eb","Handler":null,"Name":"","Endpoint":""}
Jul 06 02:39:50.150449 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.150424    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 02:39:50.150593 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.150486    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 02:39:50.224196 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.224164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:50.224343 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:50.224315    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:50.224985 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.224598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:50.224985 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:50.224683    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:50.486380 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.486345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"5ad50bf6b7781787ed929652a2654a59e5e4773e72e6d23436157b42295f1521"}
Jul 06 02:39:50.488292 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:50.488264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9" event={"ID":"72bacfad-daba-42f9-96c2-eb4240b700a2","Type":"ContainerStarted","Data":"0a7b5c7d024d0f7fc90feac21a7d135000973c785dc16df642d11355cf7c47fa"}
Jul 06 02:39:51.224443 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.224415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:51.224631 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:51.224548    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:51.364259 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.364228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:51.364760 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.364739    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:51.378205 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.378166    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nxq27" podStartSLOduration=5.408705056 podStartE2EDuration="25.37815382s" totalImagesPullingTime="19.969448764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:49.510372846 +0000 UTC m=+23.861575142" watchObservedRunningTime="2026-07-06 02:39:51.37815382 +0000 UTC m=+25.729356115"
Jul 06 02:39:51.492591 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.492513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9" event={"ID":"72bacfad-daba-42f9-96c2-eb4240b700a2","Type":"ContainerStarted","Data":"aa9c386f7721a7d24095fe701f67869d8f063110d1db0b928267644985785860"}
Jul 06 02:39:51.493070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.492752    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:51.493182 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.493149    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pgsjn"
Jul 06 02:39:51.507439 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:51.507394    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dlgk9" podStartSLOduration=3.070114101 podStartE2EDuration="25.507379455s" totalImagesPullingTime="22.437265354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:51.507358921 +0000 UTC m=+25.858561218" watchObservedRunningTime="2026-07-06 02:39:51.507379455 +0000 UTC m=+25.858581751"
Jul 06 02:39:52.224452 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:52.224421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:52.224655 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:52.224582    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:52.224722 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:52.224645    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:52.224783 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:52.224765    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:53.224115 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.223957    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:53.224611 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:53.224193    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:53.497663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.497594    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="73daaf8fea692b46d0e94b3d897ecf6dc7b222f72c06b463ace91b56899885f0" exitCode=0
Jul 06 02:39:53.497781 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.497670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"73daaf8fea692b46d0e94b3d897ecf6dc7b222f72c06b463ace91b56899885f0"}
Jul 06 02:39:53.501271 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.501250    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" event={"ID":"25a848ae-3077-469d-9d02-81f8a32e6503","Type":"ContainerStarted","Data":"843a3f0ff00eed949d2389c6ffb495514f9aa8a9efe6790e17c31d438709ac93"}
Jul 06 02:39:53.501524 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.501503    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:53.501622 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.501577    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:53.516129 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.516110    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:53.544343 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:53.544303    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm" podStartSLOduration=7.515736416 podStartE2EDuration="27.544290798s" totalImagesPullingTime="20.028554382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:39:53.542998765 +0000 UTC m=+27.894201060" watchObservedRunningTime="2026-07-06 02:39:53.544290798 +0000 UTC m=+27.895493093"
Jul 06 02:39:54.224683 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.224647    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:54.225215 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:54.224797    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:54.225215 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.224845    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:54.225215 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:54.224956    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:54.503624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.503589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:54.518878 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.518855    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:39:54.956345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.956316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tctwn"]
Jul 06 02:39:54.956548 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.956432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:54.956548 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:54.956530    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:54.959276 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.959254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q2v6m"]
Jul 06 02:39:54.959415 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.959328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:54.959513 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:54.959418    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:54.959965 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.959940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-556lk"]
Jul 06 02:39:54.960055 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:54.960025    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:54.960134 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:54.960110    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:55.507287 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:55.507250    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="3c0d661b04b7d1df977e7c3d92f10995e01a8fb6c0f855d100e6688cf9f8e594" exitCode=0
Jul 06 02:39:55.507750 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:55.507335    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"3c0d661b04b7d1df977e7c3d92f10995e01a8fb6c0f855d100e6688cf9f8e594"}
Jul 06 02:39:56.227203 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:56.227176    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:56.227348 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:56.227265    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:56.227389 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:56.227359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:56.227462 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:56.227444    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:57.224283 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:57.224255    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:57.224627 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:57.224349    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:39:57.514516 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:57.514469    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="18d705d939028bd4bc0850f11a5ca044bf346df8ccd361082cd3b99741659291" exitCode=0
Jul 06 02:39:57.514687 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:57.514550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"18d705d939028bd4bc0850f11a5ca044bf346df8ccd361082cd3b99741659291"}
Jul 06 02:39:58.227563 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:58.227536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:58.227968 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.227629    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:39:58.227968 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:58.227678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:58.228791 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.228159    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:39:58.826786 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:58.826754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:39:58.826970 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:58.826793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:58.826970 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.826917    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:58.826970 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.826935    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:58.827119 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.826992    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:30.826970518 +0000 UTC m=+65.178172792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 02:39:58.827119 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.827010    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret podName:dc5bd342-a2f7-4a82-9c47-92d06fd63a16 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:30.827002449 +0000 UTC m=+65.178204723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret") pod "global-pull-secret-syncer-tctwn" (UID: "dc5bd342-a2f7-4a82-9c47-92d06fd63a16") : object "kube-system"/"original-pull-secret" not registered
Jul 06 02:39:58.927163 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:58.927132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:39:58.927319 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.927267    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 02:39:58.927319 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.927286    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 02:39:58.927319 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.927297    2557 projected.go:196] Error preparing data for projected volume kube-api-access-b72ph for pod openshift-network-diagnostics/network-check-target-q2v6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:58.927505 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:58.927354    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph podName:98206597-7f07-413e-9b0a-518e4af28942 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:30.927337484 +0000 UTC m=+65.278539760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b72ph" (UniqueName: "kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph") pod "network-check-target-q2v6m" (UID: "98206597-7f07-413e-9b0a-518e4af28942") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 02:39:59.224947 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:39:59.224917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:39:59.225098 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:39:59.225042    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tctwn" podUID="dc5bd342-a2f7-4a82-9c47-92d06fd63a16"
Jul 06 02:40:00.224997 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.224915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:40:00.225426 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:00.225058    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:40:00.225426 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.225228    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:00.225426 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:00.225303    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q2v6m" podUID="98206597-7f07-413e-9b0a-518e4af28942"
Jul 06 02:40:00.413328 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.413303    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-33.ec2.internal" event="NodeReady"
Jul 06 02:40:00.413501 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.413443    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 02:40:00.453355 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.453321    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lhl65"]
Jul 06 02:40:00.476975 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.476910    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-24mf4"]
Jul 06 02:40:00.477110 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.477012    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.479582 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.479556    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 02:40:00.479582 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.479563    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 02:40:00.479778 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.479569    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsrhl\""
Jul 06 02:40:00.492070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.492046    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhl65"]
Jul 06 02:40:00.492184 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.492092    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24mf4"]
Jul 06 02:40:00.492184 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.492130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.494662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.494387    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 02:40:00.494662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.494419    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sfslh\""
Jul 06 02:40:00.494662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.494465    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 02:40:00.494662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.494413    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 02:40:00.639152 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cacbc36e-1d58-4e1b-90ba-939e741581a8-config-volume\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.639320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.639320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cacbc36e-1d58-4e1b-90ba-939e741581a8-tmp-dir\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.639430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlqp\" (UniqueName: \"kubernetes.io/projected/cacbc36e-1d58-4e1b-90ba-939e741581a8-kube-api-access-7hlqp\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.639430 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639373    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-cert\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.639545 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.639426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grhp5\" (UniqueName: \"kubernetes.io/projected/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-kube-api-access-grhp5\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.740543 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlqp\" (UniqueName: \"kubernetes.io/projected/cacbc36e-1d58-4e1b-90ba-939e741581a8-kube-api-access-7hlqp\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.740543 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-cert\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.740543 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grhp5\" (UniqueName: \"kubernetes.io/projected/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-kube-api-access-grhp5\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.740841 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cacbc36e-1d58-4e1b-90ba-939e741581a8-config-volume\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.740841 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.740841 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cacbc36e-1d58-4e1b-90ba-939e741581a8-tmp-dir\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.740841 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:00.740793    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:00.740998 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:00.740854    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:01.240832871 +0000 UTC m=+35.592035156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:00.740998 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.740990    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cacbc36e-1d58-4e1b-90ba-939e741581a8-tmp-dir\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.741349 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.741324    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cacbc36e-1d58-4e1b-90ba-939e741581a8-config-volume\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.745308 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.745287    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-cert\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.748886 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.748862    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlqp\" (UniqueName: \"kubernetes.io/projected/cacbc36e-1d58-4e1b-90ba-939e741581a8-kube-api-access-7hlqp\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:00.749134 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.749118    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grhp5\" (UniqueName: \"kubernetes.io/projected/8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea-kube-api-access-grhp5\") pod \"ingress-canary-24mf4\" (UID: \"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea\") " pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:00.802641 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:00.802611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24mf4"
Jul 06 02:40:01.224463 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:01.224426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:40:01.227541 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:01.227516    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 02:40:01.244598 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:01.244570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:01.244742 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:01.244725    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:01.244794 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:01.244784    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:02.244769017 +0000 UTC m=+36.595971294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:02.106459 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.106426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24mf4"]
Jul 06 02:40:02.198170 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:40:02.198143    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3a0fd9_d7f9_4412_87b9_c25ab0af03ea.slice/crio-a5c08e34b2657d330912f40e59a5759c5bdad578f55e20df04c3d96fe79f1201 WatchSource:0}: Error finding container a5c08e34b2657d330912f40e59a5759c5bdad578f55e20df04c3d96fe79f1201: Status 404 returned error can't find the container with id a5c08e34b2657d330912f40e59a5759c5bdad578f55e20df04c3d96fe79f1201
Jul 06 02:40:02.224714 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.224694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:40:02.224822 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.224700    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:02.228323 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.228302    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 02:40:02.228323 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.228312    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 02:40:02.228323 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.228323    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2bvg\""
Jul 06 02:40:02.229078 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.228323    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwf\""
Jul 06 02:40:02.229078 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.228371    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 02:40:02.252878 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.252647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:02.252878 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:02.252789    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:02.252878 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:02.252860    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:04.252841075 +0000 UTC m=+38.604043368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:02.529702 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.529458    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="ce824a474c51b004e19406665af46135a85fae00b6b03e0cbb93c1556a519943" exitCode=0
Jul 06 02:40:02.529869 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.529534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"ce824a474c51b004e19406665af46135a85fae00b6b03e0cbb93c1556a519943"}
Jul 06 02:40:02.530728 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:02.530706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24mf4" event={"ID":"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea","Type":"ContainerStarted","Data":"a5c08e34b2657d330912f40e59a5759c5bdad578f55e20df04c3d96fe79f1201"}
Jul 06 02:40:03.537317 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:03.537280    2557 generic.go:356] "Generic (PLEG): container finished" podID="a7eadb9a-e575-408d-8996-4bcef2d6e3b7" containerID="d9ffbc433c1557352265d53c420926bdde4336eff77cde06aef9e474e0cd211b" exitCode=0
Jul 06 02:40:03.537812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:03.537354    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerDied","Data":"d9ffbc433c1557352265d53c420926bdde4336eff77cde06aef9e474e0cd211b"}
Jul 06 02:40:04.269748 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:04.269711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:04.269923 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:04.269901    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:04.269993 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:04.269981    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:08.269959608 +0000 UTC m=+42.621161896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:04.543974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:04.543891    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95fkk" event={"ID":"a7eadb9a-e575-408d-8996-4bcef2d6e3b7","Type":"ContainerStarted","Data":"78af87b186e31259354c1881bf03cc217520a02eb1310cf61eb51e86dd43fa92"}
Jul 06 02:40:04.567691 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:04.567606    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-95fkk" podStartSLOduration=7.347886374 podStartE2EDuration="38.567583801s" totalImagesPullingTime="31.219697427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:04.566846907 +0000 UTC m=+38.918049224" watchObservedRunningTime="2026-07-06 02:40:04.567583801 +0000 UTC m=+38.918786098"
Jul 06 02:40:05.548087 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:05.548009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24mf4" event={"ID":"8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea","Type":"ContainerStarted","Data":"b62a964c56dbce7895b8e4c7e8512b5b37b44801bedf8fe1a6d6b57d6b922c60"}
Jul 06 02:40:05.562356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:05.562313    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-24mf4" podStartSLOduration=2.5178267500000002 podStartE2EDuration="5.56229769s" totalImagesPullingTime="3.04447094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:05.561398538 +0000 UTC m=+39.912600836" watchObservedRunningTime="2026-07-06 02:40:05.56229769 +0000 UTC m=+39.913499982"
Jul 06 02:40:08.298093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:08.298057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:08.298438 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:08.298164    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:08.298438 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:08.298217    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:16.298200008 +0000 UTC m=+50.649402285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:16.351987 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:16.351952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:16.352415 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:16.352058    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:16.352415 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:16.352104    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:40:32.352091971 +0000 UTC m=+66.703294245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:26.520401 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:26.520373    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kcglm"
Jul 06 02:40:30.843567 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.843515    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:40:30.843567 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.843567    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:40:30.846163 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.846143    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 02:40:30.846257 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.846238    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 02:40:30.854264 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:30.854241    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 02:40:30.854349 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:30.854336    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:41:34.854312487 +0000 UTC m=+129.205514778 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : secret "metrics-daemon-secret" not found
Jul 06 02:40:30.857794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.857774    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc5bd342-a2f7-4a82-9c47-92d06fd63a16-original-pull-secret\") pod \"global-pull-secret-syncer-tctwn\" (UID: \"dc5bd342-a2f7-4a82-9c47-92d06fd63a16\") " pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:40:30.934156 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.934121    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tctwn"
Jul 06 02:40:30.944677 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.944628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:30.947018 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.946997    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 02:40:30.956930 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.956901    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 02:40:30.968131 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:30.968104    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72ph\" (UniqueName: \"kubernetes.io/projected/98206597-7f07-413e-9b0a-518e4af28942-kube-api-access-b72ph\") pod \"network-check-target-q2v6m\" (UID: \"98206597-7f07-413e-9b0a-518e4af28942\") " pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:31.044235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.044173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwf\""
Jul 06 02:40:31.051984 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.051954    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:31.065344 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.065254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tctwn"]
Jul 06 02:40:31.067748 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:40:31.067724    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5bd342_a2f7_4a82_9c47_92d06fd63a16.slice/crio-d455b03107cdda3109135c729202574e64d0e39ccd8689da3674b1b3677e6913 WatchSource:0}: Error finding container d455b03107cdda3109135c729202574e64d0e39ccd8689da3674b1b3677e6913: Status 404 returned error can't find the container with id d455b03107cdda3109135c729202574e64d0e39ccd8689da3674b1b3677e6913
Jul 06 02:40:31.167204 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.167177    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q2v6m"]
Jul 06 02:40:31.170086 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:40:31.170064    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98206597_7f07_413e_9b0a_518e4af28942.slice/crio-def4c809ecf6156f017c560c5ba6823d067391d1eed03cd3e634302017a0a87d WatchSource:0}: Error finding container def4c809ecf6156f017c560c5ba6823d067391d1eed03cd3e634302017a0a87d: Status 404 returned error can't find the container with id def4c809ecf6156f017c560c5ba6823d067391d1eed03cd3e634302017a0a87d
Jul 06 02:40:31.607125 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.607087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tctwn" event={"ID":"dc5bd342-a2f7-4a82-9c47-92d06fd63a16","Type":"ContainerStarted","Data":"d455b03107cdda3109135c729202574e64d0e39ccd8689da3674b1b3677e6913"}
Jul 06 02:40:31.608514 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:31.608463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q2v6m" event={"ID":"98206597-7f07-413e-9b0a-518e4af28942","Type":"ContainerStarted","Data":"def4c809ecf6156f017c560c5ba6823d067391d1eed03cd3e634302017a0a87d"}
Jul 06 02:40:32.355144 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:32.355091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:40:32.355637 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:32.355231    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:40:32.355637 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:40:32.355316    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:41:04.355292336 +0000 UTC m=+98.706494612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:40:36.622706 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:36.622670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tctwn" event={"ID":"dc5bd342-a2f7-4a82-9c47-92d06fd63a16","Type":"ContainerStarted","Data":"2f5a2514557e559e778ecf52240b29b104cb65a598ed32134ef299b56356c297"}
Jul 06 02:40:36.624194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:36.624174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q2v6m" event={"ID":"98206597-7f07-413e-9b0a-518e4af28942","Type":"ContainerStarted","Data":"f7668fc4db0fa044b320bdf86d0e49adbf645e9ddd6d1a48f7294a600120159f"}
Jul 06 02:40:36.624307 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:36.624293    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:40:36.637419 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:36.637384    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tctwn" podStartSLOduration=65.714833312 podStartE2EDuration="1m10.637371879s" totalImagesPullingTime="4.922538567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:36.636805699 +0000 UTC m=+70.988007995" watchObservedRunningTime="2026-07-06 02:40:36.637371879 +0000 UTC m=+70.988574174"
Jul 06 02:40:36.650428 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:36.650393    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q2v6m" podStartSLOduration=65.841248995 podStartE2EDuration="1m10.650384345s" totalImagesPullingTime="4.80913535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:40:36.650258103 +0000 UTC m=+71.001460398" watchObservedRunningTime="2026-07-06 02:40:36.650384345 +0000 UTC m=+71.001586641"
Jul 06 02:40:55.684833 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.684726    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"]
Jul 06 02:40:55.689941 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.689921    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.692356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.692331    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 02:40:55.693139 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.693121    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 02:40:55.693213 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.693127    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 02:40:55.693213 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.693202    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 02:40:55.695220 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.695199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"]
Jul 06 02:40:55.807311 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.807291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ac5382-25ee-48c8-9878-126128416c38-klusterlet-config\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.807431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.807320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gvl\" (UniqueName: \"kubernetes.io/projected/82ac5382-25ee-48c8-9878-126128416c38-kube-api-access-94gvl\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.807431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.807338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ac5382-25ee-48c8-9878-126128416c38-tmp\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.908575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.908554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ac5382-25ee-48c8-9878-126128416c38-klusterlet-config\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.908666 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.908583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gvl\" (UniqueName: \"kubernetes.io/projected/82ac5382-25ee-48c8-9878-126128416c38-kube-api-access-94gvl\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.908666 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.908601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ac5382-25ee-48c8-9878-126128416c38-tmp\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.908999 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.908981    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ac5382-25ee-48c8-9878-126128416c38-tmp\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.910871 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.910854    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82ac5382-25ee-48c8-9878-126128416c38-klusterlet-config\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.916304 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.916283    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gvl\" (UniqueName: \"kubernetes.io/projected/82ac5382-25ee-48c8-9878-126128416c38-kube-api-access-94gvl\") pod \"klusterlet-addon-workmgr-57478578fc-ps49n\" (UID: \"82ac5382-25ee-48c8-9878-126128416c38\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:55.999713 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:55.999687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:40:56.116837 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:56.116809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"]
Jul 06 02:40:56.120008 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:40:56.119980    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ac5382_25ee_48c8_9878_126128416c38.slice/crio-9e0ca13a3760ef66e86be1b791278e38c4da52ea46c548364f58a63b36dda205 WatchSource:0}: Error finding container 9e0ca13a3760ef66e86be1b791278e38c4da52ea46c548364f58a63b36dda205: Status 404 returned error can't find the container with id 9e0ca13a3760ef66e86be1b791278e38c4da52ea46c548364f58a63b36dda205
Jul 06 02:40:56.673434 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:40:56.673398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n" event={"ID":"82ac5382-25ee-48c8-9878-126128416c38","Type":"ContainerStarted","Data":"9e0ca13a3760ef66e86be1b791278e38c4da52ea46c548364f58a63b36dda205"}
Jul 06 02:41:01.688127 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:01.688087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n" event={"ID":"82ac5382-25ee-48c8-9878-126128416c38","Type":"ContainerStarted","Data":"e25366ef0ab8b2dbd5729f4b24c4bbb3306e68a4c9843d4cd01c25f31016455b"}
Jul 06 02:41:01.688529 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:01.688389    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:41:01.689814 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:01.689798    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:41:01.704822 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:01.704776    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n" podStartSLOduration=2.15563178 podStartE2EDuration="6.704760932s" totalImagesPullingTime="4.549129152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:41:01.703930232 +0000 UTC m=+96.055132525" watchObservedRunningTime="2026-07-06 02:41:01.704760932 +0000 UTC m=+96.055963231"
Jul 06 02:41:04.369775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:04.369740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:41:04.370137 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:41:04.369879    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:41:04.370137 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:41:04.369942    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:42:08.369926402 +0000 UTC m=+162.721128681 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:41:07.632247 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:07.632218    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q2v6m"
Jul 06 02:41:34.869075 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:41:34.869035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:41:34.869519 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:41:34.869177    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 02:41:34.869519 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:41:34.869237    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs podName:ec75722e-44fb-4444-a909-230de918c211 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:36.869221743 +0000 UTC m=+251.220424018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs") pod "network-metrics-daemon-556lk" (UID: "ec75722e-44fb-4444-a909-230de918c211") : secret "metrics-daemon-secret" not found
Jul 06 02:42:03.487457 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:42:03.487401    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lhl65" podUID="cacbc36e-1d58-4e1b-90ba-939e741581a8"
Jul 06 02:42:03.838893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:42:03.838796    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:42:05.235544 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:42:05.235494    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-556lk" podUID="ec75722e-44fb-4444-a909-230de918c211"
Jul 06 02:42:08.380966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:42:08.380931    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:42:08.381347 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:42:08.381080    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 02:42:08.381347 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:42:08.381148    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls podName:cacbc36e-1d58-4e1b-90ba-939e741581a8 nodeName:}" failed. No retries permitted until 2026-07-06 02:44:10.381131617 +0000 UTC m=+284.732333896 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls") pod "dns-default-lhl65" (UID: "cacbc36e-1d58-4e1b-90ba-939e741581a8") : secret "dns-default-metrics-tls" not found
Jul 06 02:42:17.224400 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:42:17.224365    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:43:00.973552 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:00.973516    2557 generic.go:356] "Generic (PLEG): container finished" podID="82ac5382-25ee-48c8-9878-126128416c38" containerID="e25366ef0ab8b2dbd5729f4b24c4bbb3306e68a4c9843d4cd01c25f31016455b" exitCode=1
Jul 06 02:43:00.974025 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:00.973555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n" event={"ID":"82ac5382-25ee-48c8-9878-126128416c38","Type":"ContainerDied","Data":"e25366ef0ab8b2dbd5729f4b24c4bbb3306e68a4c9843d4cd01c25f31016455b"}
Jul 06 02:43:00.974025 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:00.973881    2557 scope.go:117] "RemoveContainer" containerID="e25366ef0ab8b2dbd5729f4b24c4bbb3306e68a4c9843d4cd01c25f31016455b"
Jul 06 02:43:01.688869 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:01.688830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:43:01.978009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:01.977980    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n" event={"ID":"82ac5382-25ee-48c8-9878-126128416c38","Type":"ContainerStarted","Data":"4362ee0ed755289f48b36661082d0f469a5e5b8bb57f6758440f768da8978e35"}
Jul 06 02:43:01.978344 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:01.978180    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:43:01.978736 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:01.978717    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57478578fc-ps49n"
Jul 06 02:43:18.440304 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.440274    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"]
Jul 06 02:43:18.443070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.443049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"
Jul 06 02:43:18.445400 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.445378    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gb8hd\""
Jul 06 02:43:18.445400 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.445387    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.446223 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.446202    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.447856 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.447837    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q5v77"]
Jul 06 02:43:18.450348 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.450332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.453608    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.453638    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-btr2k\""
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.453759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"]
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.454099    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.454167    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.455502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.455420    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.462184 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.462165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 02:43:18.464026 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.464009    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q5v77"]
Jul 06 02:43:18.528508 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.528465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-config\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.528600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.528513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-trusted-ca\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.528600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.528567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d48f2a6-b09e-4246-9603-7f558661ea10-serving-cert\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.528600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.528587    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24d8\" (UniqueName: \"kubernetes.io/projected/9d48f2a6-b09e-4246-9603-7f558661ea10-kube-api-access-t24d8\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.528700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.528638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg7t\" (UniqueName: \"kubernetes.io/projected/7f4e16ee-6abe-4f9f-9362-a7412754d753-kube-api-access-9bg7t\") pod \"volume-data-source-validator-5d456fdbcd-v88vk\" (UID: \"7f4e16ee-6abe-4f9f-9362-a7412754d753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"
Jul 06 02:43:18.545636 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.545609    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9dkpx"]
Jul 06 02:43:18.548349 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.548331    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:43:18.548461 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.548444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.551000 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.550979    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k2cw8\""
Jul 06 02:43:18.551089 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.551001    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 02:43:18.551089 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.551028    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.551232 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.551215    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 02:43:18.551335 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.551277    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 02:43:18.551606 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.551589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 02:43:18.554403 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.554383    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 02:43:18.555270 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.555252    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 02:43:18.555365 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.555258    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 02:43:18.555365 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.555359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k6b24\""
Jul 06 02:43:18.562557 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.562537    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 02:43:18.562854 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.562684    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 02:43:18.562854 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.562608    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9dkpx"]
Jul 06 02:43:18.565350 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.565315    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:43:18.628871 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.628843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-snapshots\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.628992 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.628882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d48f2a6-b09e-4246-9603-7f558661ea10-serving-cert\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.628992 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.628909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kn5v\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629101 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629082    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-config\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.629151 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8x9f\" (UniqueName: \"kubernetes.io/projected/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-kube-api-access-m8x9f\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.629151 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-trusted-ca\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.629251 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629155    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629251 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24d8\" (UniqueName: \"kubernetes.io/projected/9d48f2a6-b09e-4246-9603-7f558661ea10-kube-api-access-t24d8\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.629251 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-serving-cert\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.629376 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629376 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629301    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.629376 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629534 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629534 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg7t\" (UniqueName: \"kubernetes.io/projected/7f4e16ee-6abe-4f9f-9362-a7412754d753-kube-api-access-9bg7t\") pod \"volume-data-source-validator-5d456fdbcd-v88vk\" (UID: \"7f4e16ee-6abe-4f9f-9362-a7412754d753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"
Jul 06 02:43:18.629637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.629637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-tmp\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.629637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629795 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629651    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.629795 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.629741    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-config\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.630041 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.630023    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d48f2a6-b09e-4246-9603-7f558661ea10-trusted-ca\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.631218 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.631199    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d48f2a6-b09e-4246-9603-7f558661ea10-serving-cert\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.637388 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.637354    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg7t\" (UniqueName: \"kubernetes.io/projected/7f4e16ee-6abe-4f9f-9362-a7412754d753-kube-api-access-9bg7t\") pod \"volume-data-source-validator-5d456fdbcd-v88vk\" (UID: \"7f4e16ee-6abe-4f9f-9362-a7412754d753\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"
Jul 06 02:43:18.637618 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.637601    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24d8\" (UniqueName: \"kubernetes.io/projected/9d48f2a6-b09e-4246-9603-7f558661ea10-kube-api-access-t24d8\") pod \"console-operator-68b757fb67-q5v77\" (UID: \"9d48f2a6-b09e-4246-9603-7f558661ea10\") " pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.730759 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.730861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-tmp\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.730861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.730861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.730861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-snapshots\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.730861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kn5v\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.730881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8x9f\" (UniqueName: \"kubernetes.io/projected/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-kube-api-access-m8x9f\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.731143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-serving-cert\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.731143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731159    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.731345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731569 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731450    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-snapshots\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.731569 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731536    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731693 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:18.731580    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:43:18.731693 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:18.731597    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f67ddcd6-gplp9: secret "image-registry-tls" not found
Jul 06 02:43:18.731693 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731614    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.731693 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:18.731665    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls podName:061e2196-cce8-432d-9797-ec7ca7e718ac nodeName:}" failed. No retries permitted until 2026-07-06 02:43:19.231645904 +0000 UTC m=+233.582848182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls") pod "image-registry-57f67ddcd6-gplp9" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac") : secret "image-registry-tls" not found
Jul 06 02:43:18.731956 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.731920    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.732071 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.732049    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-tmp\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.732129 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.732094    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.732494 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.732452    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.733409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.733383    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.733507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.733436    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.733553 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.733525    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-serving-cert\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.740820 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.740799    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.740907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.740833    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8x9f\" (UniqueName: \"kubernetes.io/projected/c1922c12-c653-4aa1-a60a-f317cf3e5eb6-kube-api-access-m8x9f\") pod \"insights-operator-5c847dcfc4-9dkpx\" (UID: \"c1922c12-c653-4aa1-a60a-f317cf3e5eb6\") " pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.741028 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.741011    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kn5v\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:18.752815 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.752786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"
Jul 06 02:43:18.763083 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.762915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:18.858876 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.858846    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx"
Jul 06 02:43:18.879766 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.879744    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk"]
Jul 06 02:43:18.884204 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:18.884172    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4e16ee_6abe_4f9f_9362_a7412754d753.slice/crio-7a328a99db256641b4782ef8cc4599aa0b6a5af753d1f873e39b57c37b94ce81 WatchSource:0}: Error finding container 7a328a99db256641b4782ef8cc4599aa0b6a5af753d1f873e39b57c37b94ce81: Status 404 returned error can't find the container with id 7a328a99db256641b4782ef8cc4599aa0b6a5af753d1f873e39b57c37b94ce81
Jul 06 02:43:18.903206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.903186    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-q5v77"]
Jul 06 02:43:18.905484 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:18.905453    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d48f2a6_b09e_4246_9603_7f558661ea10.slice/crio-12f3be6f9c58d8f8b829d0385134163355eb72d259fc4175016ebbea2d91fc25 WatchSource:0}: Error finding container 12f3be6f9c58d8f8b829d0385134163355eb72d259fc4175016ebbea2d91fc25: Status 404 returned error can't find the container with id 12f3be6f9c58d8f8b829d0385134163355eb72d259fc4175016ebbea2d91fc25
Jul 06 02:43:18.987790 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:18.987715    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-9dkpx"]
Jul 06 02:43:18.991294 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:18.991267    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1922c12_c653_4aa1_a60a_f317cf3e5eb6.slice/crio-4f6627ecf2831ea509ff99d09bd403b61a2b06e3b909307fe7ee5b666223b7cf WatchSource:0}: Error finding container 4f6627ecf2831ea509ff99d09bd403b61a2b06e3b909307fe7ee5b666223b7cf: Status 404 returned error can't find the container with id 4f6627ecf2831ea509ff99d09bd403b61a2b06e3b909307fe7ee5b666223b7cf
Jul 06 02:43:19.015831 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:19.015795    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk" event={"ID":"7f4e16ee-6abe-4f9f-9362-a7412754d753","Type":"ContainerStarted","Data":"7a328a99db256641b4782ef8cc4599aa0b6a5af753d1f873e39b57c37b94ce81"}
Jul 06 02:43:19.016841 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:19.016817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx" event={"ID":"c1922c12-c653-4aa1-a60a-f317cf3e5eb6","Type":"ContainerStarted","Data":"4f6627ecf2831ea509ff99d09bd403b61a2b06e3b909307fe7ee5b666223b7cf"}
Jul 06 02:43:19.017869 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:19.017851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" event={"ID":"9d48f2a6-b09e-4246-9603-7f558661ea10","Type":"ContainerStarted","Data":"12f3be6f9c58d8f8b829d0385134163355eb72d259fc4175016ebbea2d91fc25"}
Jul 06 02:43:19.235113 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:19.235089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:19.235229 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:19.235196    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:43:19.235229 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:19.235208    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f67ddcd6-gplp9: secret "image-registry-tls" not found
Jul 06 02:43:19.235295 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:19.235254    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls podName:061e2196-cce8-432d-9797-ec7ca7e718ac nodeName:}" failed. No retries permitted until 2026-07-06 02:43:20.23524 +0000 UTC m=+234.586442274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls") pod "image-registry-57f67ddcd6-gplp9" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac") : secret "image-registry-tls" not found
Jul 06 02:43:20.243571 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:20.243521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:20.243922 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:20.243688    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:43:20.243922 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:20.243710    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f67ddcd6-gplp9: secret "image-registry-tls" not found
Jul 06 02:43:20.243922 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:20.243771    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls podName:061e2196-cce8-432d-9797-ec7ca7e718ac nodeName:}" failed. No retries permitted until 2026-07-06 02:43:22.243750804 +0000 UTC m=+236.594953090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls") pod "image-registry-57f67ddcd6-gplp9" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac") : secret "image-registry-tls" not found
Jul 06 02:43:21.028687 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:21.028645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk" event={"ID":"7f4e16ee-6abe-4f9f-9362-a7412754d753","Type":"ContainerStarted","Data":"ac9625be4a952c97ce2623f7323c74dfa69d4d6a237ecb4a77a207c0dce0b041"}
Jul 06 02:43:22.033760 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.033719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx" event={"ID":"c1922c12-c653-4aa1-a60a-f317cf3e5eb6","Type":"ContainerStarted","Data":"b5e75ba3325945bc25072f5cc569dc922c2a4d44080910cb32e3cb63083a97a1"}
Jul 06 02:43:22.035310 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.035291    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/0.log"
Jul 06 02:43:22.035425 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.035329    2557 generic.go:356] "Generic (PLEG): container finished" podID="9d48f2a6-b09e-4246-9603-7f558661ea10" containerID="6d2873912b110428543aa013da03bbbdaaa0c91b885d7ab779aab2ca7988ae49" exitCode=255
Jul 06 02:43:22.035501 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.035417    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" event={"ID":"9d48f2a6-b09e-4246-9603-7f558661ea10","Type":"ContainerDied","Data":"6d2873912b110428543aa013da03bbbdaaa0c91b885d7ab779aab2ca7988ae49"}
Jul 06 02:43:22.035585 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.035572    2557 scope.go:117] "RemoveContainer" containerID="6d2873912b110428543aa013da03bbbdaaa0c91b885d7ab779aab2ca7988ae49"
Jul 06 02:43:22.049291 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.049248    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-v88vk" podStartSLOduration=2.7940813159999998 podStartE2EDuration="4.049229699s" totalImagesPullingTime="1.255148383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:21.043729011 +0000 UTC m=+235.394931328" watchObservedRunningTime="2026-07-06 02:43:22.049229699 +0000 UTC m=+236.400431997"
Jul 06 02:43:22.050409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.050376    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx" podStartSLOduration=1.649120297 podStartE2EDuration="4.050361057s" totalImagesPullingTime="2.40124076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:22.048933815 +0000 UTC m=+236.400136143" watchObservedRunningTime="2026-07-06 02:43:22.050361057 +0000 UTC m=+236.401563336"
Jul 06 02:43:22.260271 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:22.260243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:22.260380 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:22.260355    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:43:22.260380 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:22.260366    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f67ddcd6-gplp9: secret "image-registry-tls" not found
Jul 06 02:43:22.260451 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:22.260409    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls podName:061e2196-cce8-432d-9797-ec7ca7e718ac nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.26039673 +0000 UTC m=+240.611599004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls") pod "image-registry-57f67ddcd6-gplp9" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac") : secret "image-registry-tls" not found
Jul 06 02:43:23.044159 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044134    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:43:23.044551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044542    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/0.log"
Jul 06 02:43:23.044613 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044571    2557 generic.go:356] "Generic (PLEG): container finished" podID="9d48f2a6-b09e-4246-9603-7f558661ea10" containerID="e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861" exitCode=255
Jul 06 02:43:23.044685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" event={"ID":"9d48f2a6-b09e-4246-9603-7f558661ea10","Type":"ContainerDied","Data":"e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861"}
Jul 06 02:43:23.044753 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044738    2557 scope.go:117] "RemoveContainer" containerID="6d2873912b110428543aa013da03bbbdaaa0c91b885d7ab779aab2ca7988ae49"
Jul 06 02:43:23.044957 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.044930    2557 scope.go:117] "RemoveContainer" containerID="e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861"
Jul 06 02:43:23.045140 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.045119    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q5v77_openshift-console-operator(9d48f2a6-b09e-4246-9603-7f558661ea10)\"" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" podUID="9d48f2a6-b09e-4246-9603-7f558661ea10"
Jul 06 02:43:23.227520 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.227492    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x9q5s"]
Jul 06 02:43:23.231549 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.231531    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.233686 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.233671    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 02:43:23.233862 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.233848    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 02:43:23.234189 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.234172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zj59f\""
Jul 06 02:43:23.240660 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.240639    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9q5s"]
Jul 06 02:43:23.266551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.266525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.266662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.266572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-data-volume\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.266662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.266598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-crio-socket\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.266662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.266643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.266758 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.266711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggzv6\" (UniqueName: \"kubernetes.io/projected/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-api-access-ggzv6\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367058 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.366997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggzv6\" (UniqueName: \"kubernetes.io/projected/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-api-access-ggzv6\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367058 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367031    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367188 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-data-volume\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367228 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.367189    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.367268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367237    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-crio-socket\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367311 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.367274    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:23.8672537 +0000 UTC m=+238.218455975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.367311 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367300    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-crio-socket\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367414 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-data-volume\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367414 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.367327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.367539 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.367421    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.367539 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.367455    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:23.867446857 +0000 UTC m=+238.218649132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.375227 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.375204    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggzv6\" (UniqueName: \"kubernetes.io/projected/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-api-access-ggzv6\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.870110 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.870077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.870259 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.870198    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.870259 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:23.870247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:23.870328 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.870266    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:24.870251665 +0000 UTC m=+239.221453938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:23.870365 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.870326    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:23.870399 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:23.870377    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:24.870365667 +0000 UTC m=+239.221567944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:24.048413 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:24.048384    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:43:24.048859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:24.048698    2557 scope.go:117] "RemoveContainer" containerID="e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861"
Jul 06 02:43:24.048859 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:24.048835    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q5v77_openshift-console-operator(9d48f2a6-b09e-4246-9603-7f558661ea10)\"" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" podUID="9d48f2a6-b09e-4246-9603-7f558661ea10"
Jul 06 02:43:24.879065 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:24.879032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:24.879235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:24.879085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:24.879235 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:24.879147    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:24.879235 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:24.879183    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:24.879235 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:24.879195    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.879182728 +0000 UTC m=+241.230385003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:24.879235 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:24.879231    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:26.879219629 +0000 UTC m=+241.230421903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:25.204971 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.204950    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnb6s_26082228-58e2-4d40-8743-07183c62fe27/dns-node-resolver/0.log"
Jul 06 02:43:25.497498 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.497409    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r6c5h"]
Jul 06 02:43:25.500602 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.500586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.502804 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.502781    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 02:43:25.502916 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.502897    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 02:43:25.502980 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.502912    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 02:43:25.503030 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.502983    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 02:43:25.503899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.503886    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8kckx\""
Jul 06 02:43:25.509344 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.509323    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r6c5h"]
Jul 06 02:43:25.584360 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.584334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rst6\" (UniqueName: \"kubernetes.io/projected/36e24f02-d4d4-45ef-9f43-ca5080ed969c-kube-api-access-2rst6\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.584503 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.584388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-key\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.584575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.584498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-cabundle\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.685757 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.685729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rst6\" (UniqueName: \"kubernetes.io/projected/36e24f02-d4d4-45ef-9f43-ca5080ed969c-kube-api-access-2rst6\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.685853 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.685773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-key\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.685891 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.685861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-cabundle\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.686505 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.686465    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-cabundle\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.688055 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.688034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/36e24f02-d4d4-45ef-9f43-ca5080ed969c-signing-key\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.693389 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.693370    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rst6\" (UniqueName: \"kubernetes.io/projected/36e24f02-d4d4-45ef-9f43-ca5080ed969c-kube-api-access-2rst6\") pod \"service-ca-758f599c5-r6c5h\" (UID: \"36e24f02-d4d4-45ef-9f43-ca5080ed969c\") " pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.809794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.809738    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-r6c5h"
Jul 06 02:43:25.927957 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:25.927923    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-r6c5h"]
Jul 06 02:43:25.930915 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:25.930886    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e24f02_d4d4_45ef_9f43_ca5080ed969c.slice/crio-489253cb1a77cc961dc9f8314432d96a2e3f0894fb7f72e222c78380148ffa92 WatchSource:0}: Error finding container 489253cb1a77cc961dc9f8314432d96a2e3f0894fb7f72e222c78380148ffa92: Status 404 returned error can't find the container with id 489253cb1a77cc961dc9f8314432d96a2e3f0894fb7f72e222c78380148ffa92
Jul 06 02:43:26.005519 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.005498    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sx67_ea3397fd-652a-4fd4-a5b3-dc7672131a5a/node-ca/0.log"
Jul 06 02:43:26.059512 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.059463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r6c5h" event={"ID":"36e24f02-d4d4-45ef-9f43-ca5080ed969c","Type":"ContainerStarted","Data":"489253cb1a77cc961dc9f8314432d96a2e3f0894fb7f72e222c78380148ffa92"}
Jul 06 02:43:26.291364 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.291337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:26.291744 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.291498    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 02:43:26.291744 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.291514    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f67ddcd6-gplp9: secret "image-registry-tls" not found
Jul 06 02:43:26.291744 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.291572    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls podName:061e2196-cce8-432d-9797-ec7ca7e718ac nodeName:}" failed. No retries permitted until 2026-07-06 02:43:34.291554326 +0000 UTC m=+248.642756620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls") pod "image-registry-57f67ddcd6-gplp9" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac") : secret "image-registry-tls" not found
Jul 06 02:43:26.805450 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.805422    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24mf4_8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea/serve-healthcheck-canary/0.log"
Jul 06 02:43:26.896169 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.896134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:26.896318 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:26.896202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:26.896318 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.896257    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:26.896318 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.896309    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:26.896458 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.896326    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:30.896308523 +0000 UTC m=+245.247510802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:26.896458 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:26.896348    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:30.896335706 +0000 UTC m=+245.247537980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:28.066937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:28.066845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-r6c5h" event={"ID":"36e24f02-d4d4-45ef-9f43-ca5080ed969c","Type":"ContainerStarted","Data":"ef6d167b7555a88f89ee0e7445a194bfebe98ce8bcfffcf827e1ac8fc85725c0"}
Jul 06 02:43:28.082515 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:28.082425    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-r6c5h" podStartSLOduration=1.256210293 podStartE2EDuration="3.082409308s" totalImagesPullingTime="1.826199015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:28.081767596 +0000 UTC m=+242.432969916" watchObservedRunningTime="2026-07-06 02:43:28.082409308 +0000 UTC m=+242.433611603"
Jul 06 02:43:28.763429 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:28.763348    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:28.763429 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:28.763413    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:28.763880 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:28.763859    2557 scope.go:117] "RemoveContainer" containerID="e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861"
Jul 06 02:43:28.764034 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:28.764015    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-q5v77_openshift-console-operator(9d48f2a6-b09e-4246-9603-7f558661ea10)\"" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" podUID="9d48f2a6-b09e-4246-9603-7f558661ea10"
Jul 06 02:43:30.926945 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:30.926908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:30.927337 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:30.926999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:30.927337 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:30.927028    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 02:43:30.927337 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:30.927107    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:38.92708855 +0000 UTC m=+253.278290829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : configmap "kube-rbac-proxy" not found
Jul 06 02:43:30.927337 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:30.927117    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:30.927337 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:30.927166    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:38.927155721 +0000 UTC m=+253.278357996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:34.350743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:34.350714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:34.353059 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:34.353029    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"image-registry-57f67ddcd6-gplp9\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") " pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:34.467835 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:34.467806    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k6b24\""
Jul 06 02:43:34.476096 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:34.476073    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:34.601383 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:34.601205    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:43:34.603821 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:34.603790    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061e2196_cce8_432d_9797_ec7ca7e718ac.slice/crio-da66c7057d1ea70738cfdbfc5498adf09f4c111367a901792095051a4e0f5733 WatchSource:0}: Error finding container da66c7057d1ea70738cfdbfc5498adf09f4c111367a901792095051a4e0f5733: Status 404 returned error can't find the container with id da66c7057d1ea70738cfdbfc5498adf09f4c111367a901792095051a4e0f5733
Jul 06 02:43:35.088170 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:35.088132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" event={"ID":"061e2196-cce8-432d-9797-ec7ca7e718ac","Type":"ContainerStarted","Data":"78c24608fdb19bdcbf22a2f69c54472c87838d3e7a4899dcced9fd140813f88e"}
Jul 06 02:43:35.088330 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:35.088190    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" event={"ID":"061e2196-cce8-432d-9797-ec7ca7e718ac","Type":"ContainerStarted","Data":"da66c7057d1ea70738cfdbfc5498adf09f4c111367a901792095051a4e0f5733"}
Jul 06 02:43:35.088330 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:35.088257    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:43:35.107232 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:35.107185    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" podStartSLOduration=17.107170668 podStartE2EDuration="17.107170668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:35.106425018 +0000 UTC m=+249.457627342" watchObservedRunningTime="2026-07-06 02:43:35.107170668 +0000 UTC m=+249.458372964"
Jul 06 02:43:36.871584 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:36.871550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:43:36.873877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:36.873855    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec75722e-44fb-4444-a909-230de918c211-metrics-certs\") pod \"network-metrics-daemon-556lk\" (UID: \"ec75722e-44fb-4444-a909-230de918c211\") " pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:43:37.027325 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:37.027292    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2bvg\""
Jul 06 02:43:37.035143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:37.035125    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-556lk"
Jul 06 02:43:37.162843 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:37.162769    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-556lk"]
Jul 06 02:43:37.166278 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:37.166254    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec75722e_44fb_4444_a909_230de918c211.slice/crio-b478163b161008d43395caf282cfbdfdc8bc96a44a47e00d6801e60cf49608b2 WatchSource:0}: Error finding container b478163b161008d43395caf282cfbdfdc8bc96a44a47e00d6801e60cf49608b2: Status 404 returned error can't find the container with id b478163b161008d43395caf282cfbdfdc8bc96a44a47e00d6801e60cf49608b2
Jul 06 02:43:38.100810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:38.100776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-556lk" event={"ID":"ec75722e-44fb-4444-a909-230de918c211","Type":"ContainerStarted","Data":"b478163b161008d43395caf282cfbdfdc8bc96a44a47e00d6801e60cf49608b2"}
Jul 06 02:43:38.988285 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:38.988252    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:38.988497 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:38.988308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:38.988497 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:38.988401    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:38.988497 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:38.988451    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls podName:2bdfa3cb-4eed-4178-b060-fd58c95f1d4e nodeName:}" failed. No retries permitted until 2026-07-06 02:43:54.988437992 +0000 UTC m=+269.339640267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9q5s" (UID: "2bdfa3cb-4eed-4178-b060-fd58c95f1d4e") : secret "insights-runtime-extractor-tls" not found
Jul 06 02:43:38.988852 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:38.988829    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:39.106247 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:39.106211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-556lk" event={"ID":"ec75722e-44fb-4444-a909-230de918c211","Type":"ContainerStarted","Data":"f0c88941c1eb6ebeab7729fa75b352e36afdaefbc5b83faf1bfdd65e2971b328"}
Jul 06 02:43:39.106663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:39.106270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-556lk" event={"ID":"ec75722e-44fb-4444-a909-230de918c211","Type":"ContainerStarted","Data":"93ab290f00bdfb2293651f82663be6e764a4ebd9280981f40f90435366a726e8"}
Jul 06 02:43:39.122102 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:39.122050    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-556lk" podStartSLOduration=252.031644006 podStartE2EDuration="4m13.122034329s" totalImagesPullingTime="1.090390323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:39.120143643 +0000 UTC m=+253.471345982" watchObservedRunningTime="2026-07-06 02:43:39.122034329 +0000 UTC m=+253.473236625"
Jul 06 02:43:41.224861 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:41.224831    2557 scope.go:117] "RemoveContainer" containerID="e74c260f1702212e1e752110a49daa1de00e78e417d705c164550ecf33805861"
Jul 06 02:43:42.118243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:42.118215    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:43:42.118409 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:42.118305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" event={"ID":"9d48f2a6-b09e-4246-9603-7f558661ea10","Type":"ContainerStarted","Data":"7e8506152ea85a589a4eca26c989eeffa2e9b0eed3cea8d13937d98d5a3c8233"}
Jul 06 02:43:42.118630 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:42.118610    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:42.123090 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:42.123067    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-q5v77"
Jul 06 02:43:42.134143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:42.134096    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-q5v77" podStartSLOduration=21.644080586 podStartE2EDuration="24.134082622s" totalImagesPullingTime="2.490002036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:42.133378297 +0000 UTC m=+256.484580594" watchObservedRunningTime="2026-07-06 02:43:42.134082622 +0000 UTC m=+256.485284917"
Jul 06 02:43:44.994905 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:44.994877    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-qbh28"]
Jul 06 02:43:45.000575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.000552    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:43:45.001627 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.001602    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:43:45.002810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.002782    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 02:43:45.003196 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.003175    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5bnmf\""
Jul 06 02:43:45.003306 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.003289    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 02:43:45.008026 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.007974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qbh28"]
Jul 06 02:43:45.041374 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.041340    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"]
Jul 06 02:43:45.045765 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.045731    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.055860 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.055838    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"]
Jul 06 02:43:45.134685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92z9\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-kube-api-access-d92z9\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.134849 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmz4\" (UniqueName: \"kubernetes.io/projected/f0b970af-4dd5-4d2a-afdb-5f64de0e12c7-kube-api-access-lnmz4\") pod \"downloads-685bfb5f64-qbh28\" (UID: \"f0b970af-4dd5-4d2a-afdb-5f64de0e12c7\") " pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:43:45.134849 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-certificates\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.134849 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-installation-pull-secrets\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.134849 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-bound-sa-token\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.134849 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134811    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-tls\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.135010 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-image-registry-private-configuration\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.135010 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d480bd0-a7b5-44a2-904b-e245098e62eb-ca-trust-extracted\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.135010 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.134942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-trusted-ca\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.235636 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.235594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-image-registry-private-configuration\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.235812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.235650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d480bd0-a7b5-44a2-904b-e245098e62eb-ca-trust-extracted\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.235812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.235693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-trusted-ca\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.235812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.235723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92z9\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-kube-api-access-d92z9\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.235812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.235750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmz4\" (UniqueName: \"kubernetes.io/projected/f0b970af-4dd5-4d2a-afdb-5f64de0e12c7-kube-api-access-lnmz4\") pod \"downloads-685bfb5f64-qbh28\" (UID: \"f0b970af-4dd5-4d2a-afdb-5f64de0e12c7\") " pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:43:45.236086 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-certificates\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.236086 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-installation-pull-secrets\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.236086 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236075    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-bound-sa-token\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.236245 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236118    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-tls\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.236245 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236132    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d480bd0-a7b5-44a2-904b-e245098e62eb-ca-trust-extracted\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.236922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.236897    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-certificates\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.237812 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.237784    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d480bd0-a7b5-44a2-904b-e245098e62eb-trusted-ca\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.238610 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.238589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-image-registry-private-configuration\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.238881 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.238850    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-registry-tls\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.239138 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.239115    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d480bd0-a7b5-44a2-904b-e245098e62eb-installation-pull-secrets\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.244791 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.244767    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmz4\" (UniqueName: \"kubernetes.io/projected/f0b970af-4dd5-4d2a-afdb-5f64de0e12c7-kube-api-access-lnmz4\") pod \"downloads-685bfb5f64-qbh28\" (UID: \"f0b970af-4dd5-4d2a-afdb-5f64de0e12c7\") " pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:43:45.244969 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.244918    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92z9\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-kube-api-access-d92z9\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.245048 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.244972    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d480bd0-a7b5-44a2-904b-e245098e62eb-bound-sa-token\") pod \"image-registry-6f4d5c95f8-v2t4g\" (UID: \"1d480bd0-a7b5-44a2-904b-e245098e62eb\") " pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.312360 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.312328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:43:45.354953 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.354919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:45.490627 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.490603    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-qbh28"]
Jul 06 02:43:45.492983 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:45.492956    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b970af_4dd5_4d2a_afdb_5f64de0e12c7.slice/crio-27783785dec0a900b5074ce2f9d8dc9ab78814ae39791add23a50ba2ef7064cc WatchSource:0}: Error finding container 27783785dec0a900b5074ce2f9d8dc9ab78814ae39791add23a50ba2ef7064cc: Status 404 returned error can't find the container with id 27783785dec0a900b5074ce2f9d8dc9ab78814ae39791add23a50ba2ef7064cc
Jul 06 02:43:45.507026 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:45.506996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"]
Jul 06 02:43:45.509799 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:43:45.509774    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d480bd0_a7b5_44a2_904b_e245098e62eb.slice/crio-f4e82d55ad9c8aeab1734359d7024f61c6995ef2278656ad0f7f3f85c7341bac WatchSource:0}: Error finding container f4e82d55ad9c8aeab1734359d7024f61c6995ef2278656ad0f7f3f85c7341bac: Status 404 returned error can't find the container with id f4e82d55ad9c8aeab1734359d7024f61c6995ef2278656ad0f7f3f85c7341bac
Jul 06 02:43:46.133609 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:46.133569    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qbh28" event={"ID":"f0b970af-4dd5-4d2a-afdb-5f64de0e12c7","Type":"ContainerStarted","Data":"27783785dec0a900b5074ce2f9d8dc9ab78814ae39791add23a50ba2ef7064cc"}
Jul 06 02:43:46.135207 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:46.135176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g" event={"ID":"1d480bd0-a7b5-44a2-904b-e245098e62eb","Type":"ContainerStarted","Data":"c0cd0aff2490307652ce3aeb5293e12abfa6cf7c06b8fd3cfc41ab79579cba9e"}
Jul 06 02:43:46.135348 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:46.135228    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g" event={"ID":"1d480bd0-a7b5-44a2-904b-e245098e62eb","Type":"ContainerStarted","Data":"f4e82d55ad9c8aeab1734359d7024f61c6995ef2278656ad0f7f3f85c7341bac"}
Jul 06 02:43:46.135348 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:46.135326    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:43:46.153903 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:46.153861    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g" podStartSLOduration=1.153847437 podStartE2EDuration="1.153847437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:43:46.152276743 +0000 UTC m=+260.503479066" watchObservedRunningTime="2026-07-06 02:43:46.153847437 +0000 UTC m=+260.505049734"
Jul 06 02:43:55.008117 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.008022    2557 patch_prober.go:28] interesting pod/image-registry-57f67ddcd6-gplp9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 02:43:55.008117 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.008081    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 02:43:55.014256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.014225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:55.016658 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.016635    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2bdfa3cb-4eed-4178-b060-fd58c95f1d4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9q5s\" (UID: \"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e\") " pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:55.042817 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.042794    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zj59f\""
Jul 06 02:43:55.051689 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:55.051666    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9q5s"
Jul 06 02:43:56.116317 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.116275    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"]
Jul 06 02:43:56.120828 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.120801    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.124722 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.124695    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 02:43:56.125070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.124875    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 02:43:56.125070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.124901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9wl4f\""
Jul 06 02:43:56.125070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.124746    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 02:43:56.125070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.124831    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 02:43:56.125070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.125070    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 02:43:56.130051 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.130026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"]
Jul 06 02:43:56.227372 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.227343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.227574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.227394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.227574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.227484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.227574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.227520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kpv\" (UniqueName: \"kubernetes.io/projected/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-kube-api-access-z8kpv\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.328772 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.328735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.328951 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.328797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.328951 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.328835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kpv\" (UniqueName: \"kubernetes.io/projected/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-kube-api-access-z8kpv\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.328951 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.328909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.329124 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:56.328957    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 02:43:56.329124 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:43:56.329029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls podName:d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9 nodeName:}" failed. No retries permitted until 2026-07-06 02:43:56.829008987 +0000 UTC m=+271.180211273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-h86lk" (UID: "d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9") : secret "prometheus-operator-tls" not found
Jul 06 02:43:56.329657 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.329633    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.331415 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.331390    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.337661 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.337639    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kpv\" (UniqueName: \"kubernetes.io/projected/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-kube-api-access-z8kpv\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.834412 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.834379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:56.837217 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:56.837189    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-h86lk\" (UID: \"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:43:57.035926 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:43:57.035881    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"
Jul 06 02:44:01.599810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:01.599783    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk"]
Jul 06 02:44:01.610662 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:01.610634    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b6e7a4_fafd_4af8_ad62_718d3f1b80b9.slice/crio-385b2a4a92d0419fcb7214a10fae1f75cd75b22c8726411d4d9863b0ff54193b WatchSource:0}: Error finding container 385b2a4a92d0419fcb7214a10fae1f75cd75b22c8726411d4d9863b0ff54193b: Status 404 returned error can't find the container with id 385b2a4a92d0419fcb7214a10fae1f75cd75b22c8726411d4d9863b0ff54193b
Jul 06 02:44:01.616665 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:01.616606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9q5s"]
Jul 06 02:44:02.195402 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.195257    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9q5s" event={"ID":"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e","Type":"ContainerStarted","Data":"147e0f437e118413a210dac38ac150dd4727084e125d75acdbe9beef25b65f31"}
Jul 06 02:44:02.199501 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.198466    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-qbh28" event={"ID":"f0b970af-4dd5-4d2a-afdb-5f64de0e12c7","Type":"ContainerStarted","Data":"c2b9677a148331aa52fc7516f6a3370efa55dbd0e74b020329bbefc1af356fcc"}
Jul 06 02:44:02.199501 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.199424    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:44:02.203603 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.203549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk" event={"ID":"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9","Type":"ContainerStarted","Data":"385b2a4a92d0419fcb7214a10fae1f75cd75b22c8726411d4d9863b0ff54193b"}
Jul 06 02:44:02.207700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.207674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-qbh28"
Jul 06 02:44:02.215760 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:02.215040    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-qbh28" podStartSLOduration=2.139776159 podStartE2EDuration="18.215022944s" totalImagesPullingTime="16.075246785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:02.21450648 +0000 UTC m=+276.565708802" watchObservedRunningTime="2026-07-06 02:44:02.215022944 +0000 UTC m=+276.566225240"
Jul 06 02:44:05.008502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:05.008422    2557 patch_prober.go:28] interesting pod/image-registry-57f67ddcd6-gplp9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 02:44:05.008946 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:05.008507    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 02:44:05.361674 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:05.361590    2557 patch_prober.go:28] interesting pod/image-registry-6f4d5c95f8-v2t4g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 02:44:05.361674 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:05.361647    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g" podUID="1d480bd0-a7b5-44a2-904b-e245098e62eb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 02:44:06.839792 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:44:06.839739    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lhl65" podUID="cacbc36e-1d58-4e1b-90ba-939e741581a8"
Jul 06 02:44:07.144957 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:07.144879    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f4d5c95f8-v2t4g"
Jul 06 02:44:07.224614 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:07.224587    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:08.230643 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:08.230544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk" event={"ID":"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9","Type":"ContainerStarted","Data":"d784387b805db28611592c0f577689f08ad85d736bb53da8daf3516c621db867"}
Jul 06 02:44:08.230643 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:08.230606    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk" event={"ID":"d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9","Type":"ContainerStarted","Data":"d295ddee910442f599fd5e48d09ca689cd1065561c1d971558d9245517d33532"}
Jul 06 02:44:08.232391 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:08.232365    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9q5s" event={"ID":"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e","Type":"ContainerStarted","Data":"d945b530c933f68bc11ab0819ad5c01e16b3157131d8e6f171bd31ad0d832b3c"}
Jul 06 02:44:08.248943 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:08.248889    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-h86lk" podStartSLOduration=6.654102394 podStartE2EDuration="12.248873141s" totalImagesPullingTime="5.594770747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:08.247652207 +0000 UTC m=+282.598854529" watchObservedRunningTime="2026-07-06 02:44:08.248873141 +0000 UTC m=+282.600075437"
Jul 06 02:44:09.238608 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:09.238454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9q5s" event={"ID":"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e","Type":"ContainerStarted","Data":"aaea1614824a96f13002277a6adcd404979aa3cbd242d153337083a2768f061b"}
Jul 06 02:44:10.024000 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.023719    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry" containerID="cri-o://78c24608fdb19bdcbf22a2f69c54472c87838d3e7a4899dcced9fd140813f88e" gracePeriod=30
Jul 06 02:44:10.245824 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.245739    2557 generic.go:356] "Generic (PLEG): container finished" podID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerID="78c24608fdb19bdcbf22a2f69c54472c87838d3e7a4899dcced9fd140813f88e" exitCode=0
Jul 06 02:44:10.245824 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.245774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" event={"ID":"061e2196-cce8-432d-9797-ec7ca7e718ac","Type":"ContainerDied","Data":"78c24608fdb19bdcbf22a2f69c54472c87838d3e7a4899dcced9fd140813f88e"}
Jul 06 02:44:10.318538 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.318232    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353261    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353321    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353351    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353396    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kn5v\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353419    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353451    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353498    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.354004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.353534    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") pod \"061e2196-cce8-432d-9797-ec7ca7e718ac\" (UID: \"061e2196-cce8-432d-9797-ec7ca7e718ac\") "
Jul 06 02:44:10.355013 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.354625    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:10.355365 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.355318    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:44:10.356810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.356764    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:10.357178 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.357153    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:44:10.358126 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.358084    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:10.366036 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.366012    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:44:10.366445 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.366414    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:10.368529 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.368491    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v" (OuterVolumeSpecName: "kube-api-access-6kn5v") pod "061e2196-cce8-432d-9797-ec7ca7e718ac" (UID: "061e2196-cce8-432d-9797-ec7ca7e718ac"). InnerVolumeSpecName "kube-api-access-6kn5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:44:10.448727 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.447352    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"]
Jul 06 02:44:10.448727 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.447701    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry"
Jul 06 02:44:10.448727 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.447724    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry"
Jul 06 02:44:10.448727 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.447798    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" containerName="registry"
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455562    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kn5v\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-kube-api-access-6kn5v\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455578    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-trusted-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455591    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-installation-pull-secrets\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455605    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/061e2196-cce8-432d-9797-ec7ca7e718ac-image-registry-private-configuration\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455618    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455631    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/061e2196-cce8-432d-9797-ec7ca7e718ac-bound-sa-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455643    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/061e2196-cce8-432d-9797-ec7ca7e718ac-ca-trust-extracted\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.456183 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.455656    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/061e2196-cce8-432d-9797-ec7ca7e718ac-registry-certificates\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:44:10.460709 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.460599    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cacbc36e-1d58-4e1b-90ba-939e741581a8-metrics-tls\") pod \"dns-default-lhl65\" (UID: \"cacbc36e-1d58-4e1b-90ba-939e741581a8\") " pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:10.492233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.490924    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zdmt4"]
Jul 06 02:44:10.493645 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.492557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.497207 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.494986    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tvd86\""
Jul 06 02:44:10.497207 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.495623    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 02:44:10.497207 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.495818    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 02:44:10.508345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.508293    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"]
Jul 06 02:44:10.508446 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.508415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.511080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.510847    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6wxmd\""
Jul 06 02:44:10.511080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.510867    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 02:44:10.511505 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.511435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 02:44:10.511597 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.511534    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 02:44:10.527774 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.527703    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsrhl\""
Jul 06 02:44:10.536536 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.536511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:10.659252 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-wtmp\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659405 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659268    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-metrics-client-ca\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659405 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659405 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmv5t\" (UniqueName: \"kubernetes.io/projected/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-kube-api-access-dmv5t\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.659405 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-root\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bvz\" (UniqueName: \"kubernetes.io/projected/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-kube-api-access-k6bvz\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-textfile\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.659650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-sys\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.660010 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.659666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-tls\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.752979 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.752940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lhl65"]
Jul 06 02:44:10.756916 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:10.756862    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacbc36e_1d58_4e1b_90ba_939e741581a8.slice/crio-9e94a68b878f56e25e17d00b2bf20f5357ef383da5e379a1614dafa149424fd2 WatchSource:0}: Error finding container 9e94a68b878f56e25e17d00b2bf20f5357ef383da5e379a1614dafa149424fd2: Status 404 returned error can't find the container with id 9e94a68b878f56e25e17d00b2bf20f5357ef383da5e379a1614dafa149424fd2
Jul 06 02:44:10.760203 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760153    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-wtmp\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760203 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-metrics-client-ca\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760256    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmv5t\" (UniqueName: \"kubernetes.io/projected/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-kube-api-access-dmv5t\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-root\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bvz\" (UniqueName: \"kubernetes.io/projected/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-kube-api-access-k6bvz\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760377    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760462    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-textfile\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-sys\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-tls\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.760870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760798    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-metrics-client-ca\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761464 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.761032    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-textfile\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761464 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.761430    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761464 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.761459    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-sys\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.760344    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-wtmp\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.761541    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-root\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.761663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.761546    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.763329 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.763308    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-tls\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.763805 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.763782    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.764194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.764140    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.766164 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.766143    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.769922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.769902    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmv5t\" (UniqueName: \"kubernetes.io/projected/f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d-kube-api-access-dmv5t\") pod \"openshift-state-metrics-54cf96dfcf-5rrcp\" (UID: \"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.773648 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.773606    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bvz\" (UniqueName: \"kubernetes.io/projected/7c2b83ac-4b51-44aa-9c92-ee85bbb102af-kube-api-access-k6bvz\") pod \"node-exporter-zdmt4\" (UID: \"7c2b83ac-4b51-44aa-9c92-ee85bbb102af\") " pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.808739 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.808201    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"
Jul 06 02:44:10.820600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.820557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdmt4"
Jul 06 02:44:10.870661 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:10.870627    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2b83ac_4b51_44aa_9c92_ee85bbb102af.slice/crio-01346477e8069bf2fd57c0f2c9f8822da0f0c5d466f3f086be2afc92d7f4f09a WatchSource:0}: Error finding container 01346477e8069bf2fd57c0f2c9f8822da0f0c5d466f3f086be2afc92d7f4f09a: Status 404 returned error can't find the container with id 01346477e8069bf2fd57c0f2c9f8822da0f0c5d466f3f086be2afc92d7f4f09a
Jul 06 02:44:10.992695 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:10.992659    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp"]
Jul 06 02:44:11.253536 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.253501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9" event={"ID":"061e2196-cce8-432d-9797-ec7ca7e718ac","Type":"ContainerDied","Data":"da66c7057d1ea70738cfdbfc5498adf09f4c111367a901792095051a4e0f5733"}
Jul 06 02:44:11.253536 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.253521    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f67ddcd6-gplp9"
Jul 06 02:44:11.254017 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.253567    2557 scope.go:117] "RemoveContainer" containerID="78c24608fdb19bdcbf22a2f69c54472c87838d3e7a4899dcced9fd140813f88e"
Jul 06 02:44:11.258079 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.258004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdmt4" event={"ID":"7c2b83ac-4b51-44aa-9c92-ee85bbb102af","Type":"ContainerStarted","Data":"01346477e8069bf2fd57c0f2c9f8822da0f0c5d466f3f086be2afc92d7f4f09a"}
Jul 06 02:44:11.260938 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.260912    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp" event={"ID":"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d","Type":"ContainerStarted","Data":"aa28ff04ffe01e4cc8fd7f244cb59acb0553c85c01a10af85b340fcb91dedc4b"}
Jul 06 02:44:11.261062 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.260969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp" event={"ID":"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d","Type":"ContainerStarted","Data":"6faf32d512f0b6fefdb0f1a943899b3a7c091fa32d58a2dc9a1fc3b902fd9d84"}
Jul 06 02:44:11.263519 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.263445    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhl65" event={"ID":"cacbc36e-1d58-4e1b-90ba-939e741581a8","Type":"ContainerStarted","Data":"9e94a68b878f56e25e17d00b2bf20f5357ef383da5e379a1614dafa149424fd2"}
Jul 06 02:44:11.281271 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.281252    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:44:11.286545 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.286495    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57f67ddcd6-gplp9"]
Jul 06 02:44:11.521428 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.521395    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:44:11.550292 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.550201    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:44:11.550720 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.550644    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.554008 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.553223    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 02:44:11.554008 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.553675    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 02:44:11.554008 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.553947    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 02:44:11.556104 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.554228    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 02:44:11.556920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.556781    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 02:44:11.557040 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.556962    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 02:44:11.559958 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.558394    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 02:44:11.559958 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.558560    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 02:44:11.559958 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.558968    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pb6qt\""
Jul 06 02:44:11.561467 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.561293    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 02:44:11.566519 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566622 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566622 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdk2b\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566622 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.566793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.567021 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.567021 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.567021 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.567021 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.566870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.667786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.667886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.667963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdk2b\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668072    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668104    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668136    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.668823 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668705    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.670390 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.668918    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.670390 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:44:11.669008    2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 02:44:11.670390 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:44:11.669069    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls podName:d4d8ed00-3c96-4a9d-b74b-5b28257d5d75 nodeName:}" failed. No retries permitted until 2026-07-06 02:44:12.169049121 +0000 UTC m=+286.520251411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75") : secret "alertmanager-main-tls" not found
Jul 06 02:44:11.670600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.670409    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.672893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.672844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.673445 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.673164    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.674358 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.673555    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.674358 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.673651    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.674358 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.673939    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.674358 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.674306    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.675104 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.675051    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.675257 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.675216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:11.677387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:11.677325    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdk2b\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:12.172381 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:12.172348    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:12.172566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:44:12.172492    2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 02:44:12.172566 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:44:12.172561    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls podName:d4d8ed00-3c96-4a9d-b74b-5b28257d5d75 nodeName:}" failed. No retries permitted until 2026-07-06 02:44:13.17254207 +0000 UTC m=+287.523744361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75") : secret "alertmanager-main-tls" not found
Jul 06 02:44:12.231958 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:12.231926    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="061e2196-cce8-432d-9797-ec7ca7e718ac" path="/var/lib/kubelet/pods/061e2196-cce8-432d-9797-ec7ca7e718ac/volumes"
Jul 06 02:44:13.181426 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:13.181387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:13.184008 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:13.183980    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:13.274314 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:13.274279    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp" event={"ID":"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d","Type":"ContainerStarted","Data":"0ae3f9031284811fd57b94bd47124d5f10c9d377987182294e4f3d568f895688"}
Jul 06 02:44:13.366687 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:13.366645    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:44:13.614627 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:13.614578    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:44:13.616970 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:13.616945    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d8ed00_3c96_4a9d_b74b_5b28257d5d75.slice/crio-704b8481fbcf79c15738cbf383d574f35044ffe87d91a3dcc49df7ca0d4039af WatchSource:0}: Error finding container 704b8481fbcf79c15738cbf383d574f35044ffe87d91a3dcc49df7ca0d4039af: Status 404 returned error can't find the container with id 704b8481fbcf79c15738cbf383d574f35044ffe87d91a3dcc49df7ca0d4039af
Jul 06 02:44:14.279293 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.279261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"704b8481fbcf79c15738cbf383d574f35044ffe87d91a3dcc49df7ca0d4039af"}
Jul 06 02:44:14.280836 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.280813    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhl65" event={"ID":"cacbc36e-1d58-4e1b-90ba-939e741581a8","Type":"ContainerStarted","Data":"77818e285180f6e9cfccdaa1f9a7245a622fc6f5c434e181a76ca6fe5908158e"}
Jul 06 02:44:14.282807 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.282777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9q5s" event={"ID":"2bdfa3cb-4eed-4178-b060-fd58c95f1d4e","Type":"ContainerStarted","Data":"6623863aec41776e8e9abbd17e47bca3be5ef67058043fe565d105d020e40d5f"}
Jul 06 02:44:14.302181 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.302142    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x9q5s" podStartSLOduration=39.725363885 podStartE2EDuration="51.302126338s" totalImagesPullingTime="11.576762453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 02:43:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:14.300356906 +0000 UTC m=+288.651559221" watchObservedRunningTime="2026-07-06 02:44:14.302126338 +0000 UTC m=+288.653328633"
Jul 06 02:44:14.860393 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.860355    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"]
Jul 06 02:44:14.875238 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.875212    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"]
Jul 06 02:44:14.875382 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.875314    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.879279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879078    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 02:44:14.879279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879097    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 02:44:14.879279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879159    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 02:44:14.879279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879077    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 02:44:14.879279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879077    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q54rb\""
Jul 06 02:44:14.879997 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.879518    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7h4551se96idn\""
Jul 06 02:44:14.900593 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2f78d386-b986-4884-8147-80215e6342b7-audit-log\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900593 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-client-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-client-certs\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-tls\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg5lp\" (UniqueName: \"kubernetes.io/projected/2f78d386-b986-4884-8147-80215e6342b7-kube-api-access-cg5lp\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900903 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:14.900903 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:14.900812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-metrics-server-audit-profiles\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001605 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2f78d386-b986-4884-8147-80215e6342b7-audit-log\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001754 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001626    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-client-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001754 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001694    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-client-certs\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001754 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-tls\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001924 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001780    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg5lp\" (UniqueName: \"kubernetes.io/projected/2f78d386-b986-4884-8147-80215e6342b7-kube-api-access-cg5lp\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001924 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.001924 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.001861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-metrics-server-audit-profiles\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.002257 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.002226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2f78d386-b986-4884-8147-80215e6342b7-audit-log\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.002843 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.002791    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.002952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.002901    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2f78d386-b986-4884-8147-80215e6342b7-metrics-server-audit-profiles\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.004345 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.004316    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-client-ca-bundle\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.004757 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.004735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-client-certs\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.004846 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.004762    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2f78d386-b986-4884-8147-80215e6342b7-secret-metrics-server-tls\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.009650 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.009629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg5lp\" (UniqueName: \"kubernetes.io/projected/2f78d386-b986-4884-8147-80215e6342b7-kube-api-access-cg5lp\") pod \"metrics-server-6d7f67c9cf-88kjk\" (UID: \"2f78d386-b986-4884-8147-80215e6342b7\") " pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.186273 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.186186    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:15.289847 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.289757    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lhl65" event={"ID":"cacbc36e-1d58-4e1b-90ba-939e741581a8","Type":"ContainerStarted","Data":"b33031c5d1d52cc59877023212105aaafd4d91cc69ddeed8b62a0870ebe837c0"}
Jul 06 02:44:15.290303 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.289903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:15.291569 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.291542    2557 generic.go:356] "Generic (PLEG): container finished" podID="7c2b83ac-4b51-44aa-9c92-ee85bbb102af" containerID="d20560559001739f1d32073b5fdb559e633dab76c02a982669dde6aa1e9abab9" exitCode=0
Jul 06 02:44:15.291670 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.291630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdmt4" event={"ID":"7c2b83ac-4b51-44aa-9c92-ee85bbb102af","Type":"ContainerDied","Data":"d20560559001739f1d32073b5fdb559e633dab76c02a982669dde6aa1e9abab9"}
Jul 06 02:44:15.305835 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.305798    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lhl65" podStartSLOduration=251.981598487 podStartE2EDuration="4m15.305780749s" totalImagesPullingTime="3.324182262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:15.304214447 +0000 UTC m=+289.655417003" watchObservedRunningTime="2026-07-06 02:44:15.305780749 +0000 UTC m=+289.656983081"
Jul 06 02:44:15.436762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:15.436739    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"]
Jul 06 02:44:15.440099 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:15.440067    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f78d386_b986_4884_8147_80215e6342b7.slice/crio-c37b0bfd7a959db8b313135409527ef51588b75fbfff218bd6c585ceac1a2fd2 WatchSource:0}: Error finding container c37b0bfd7a959db8b313135409527ef51588b75fbfff218bd6c585ceac1a2fd2: Status 404 returned error can't find the container with id c37b0bfd7a959db8b313135409527ef51588b75fbfff218bd6c585ceac1a2fd2
Jul 06 02:44:16.298307 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.298271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdmt4" event={"ID":"7c2b83ac-4b51-44aa-9c92-ee85bbb102af","Type":"ContainerStarted","Data":"2065489b890248e2fae0d7f54686cbf0fb86ac49a71df70a57a578d5ca103b9e"}
Jul 06 02:44:16.298763 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.298325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdmt4" event={"ID":"7c2b83ac-4b51-44aa-9c92-ee85bbb102af","Type":"ContainerStarted","Data":"7b09b09127434ca58285d69a8e765fded58d4d7a36f9a8f8505b959010f755a1"}
Jul 06 02:44:16.300198 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.300167    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk" event={"ID":"2f78d386-b986-4884-8147-80215e6342b7","Type":"ContainerStarted","Data":"c37b0bfd7a959db8b313135409527ef51588b75fbfff218bd6c585ceac1a2fd2"}
Jul 06 02:44:16.302702 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.302673    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp" event={"ID":"f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d","Type":"ContainerStarted","Data":"bc84b8b081c37c750ebebae045bb276549abc14638d6027721f57c731f86616f"}
Jul 06 02:44:16.304267 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.304239    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5" exitCode=0
Jul 06 02:44:16.304364 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.304330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"}
Jul 06 02:44:16.334775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.334718    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zdmt4" podStartSLOduration=2.450201322 podStartE2EDuration="6.33470061s" totalImagesPullingTime="3.774997145s" totalInitContainerRuntime="109.502143ms" isStatefulPod=true podCreationTimestamp="2026-07-06 02:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:16.317175296 +0000 UTC m=+290.668377593" watchObservedRunningTime="2026-07-06 02:44:16.33470061 +0000 UTC m=+290.685902888"
Jul 06 02:44:16.334983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.334955    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5rrcp" podStartSLOduration=3.699632677 podStartE2EDuration="6.334947s" totalImagesPullingTime="2.635314323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:16.333084331 +0000 UTC m=+290.684286641" watchObservedRunningTime="2026-07-06 02:44:16.334947 +0000 UTC m=+290.686149296"
Jul 06 02:44:16.694108 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.694029    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:44:16.724466 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.724384    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:44:16.724655 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.724550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.727867 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.727686    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 02:44:16.727867 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.727700    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 02:44:16.727867 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.727737    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 02:44:16.728171 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.727904    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 02:44:16.728301 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.728212    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tsqjp\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729053    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729239    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729401    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729494    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729535    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729677    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fpi899argkcc2\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729709    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 02:44:16.729857 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.729755    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 02:44:16.732070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.731990    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 02:44:16.734821 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.734804    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 02:44:16.814743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814787    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.814966 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.814962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815219    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch5vb\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815444    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.815649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.815468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916047 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916047 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916053    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916107    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.916296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.916245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917583 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917056    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917583 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917203    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917583 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917538    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917583 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917642    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917800    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.917859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch5vb\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.918272 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.917904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.919412 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.919100    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.921364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.921804    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.921940    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.921975    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.922197    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.922646 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.922617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.923306 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.923009    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.923306 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.923026    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.923947 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.923923    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.924796 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.924771    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.925519 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.925364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.925519 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.925375    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.925845 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.925805    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.926130 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.926090    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.926879 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.926860    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:16.931804 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:16.931783    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch5vb\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb\") pod \"prometheus-k8s-0\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:17.038191 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:17.038159    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:17.241012 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:17.240974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:44:17.244866 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:44:17.244836    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f47cd1_5c8e_49e8_a52c_6af3062ee716.slice/crio-a081d9811b3d4f9b82d74f6251d1d6fc8e43eece85bee78cafd9c90cd7fbaa76 WatchSource:0}: Error finding container a081d9811b3d4f9b82d74f6251d1d6fc8e43eece85bee78cafd9c90cd7fbaa76: Status 404 returned error can't find the container with id a081d9811b3d4f9b82d74f6251d1d6fc8e43eece85bee78cafd9c90cd7fbaa76
Jul 06 02:44:17.309224 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:17.309163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"a081d9811b3d4f9b82d74f6251d1d6fc8e43eece85bee78cafd9c90cd7fbaa76"}
Jul 06 02:44:18.314543 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:18.314501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk" event={"ID":"2f78d386-b986-4884-8147-80215e6342b7","Type":"ContainerStarted","Data":"967387c59a1c7909a0b4bd2669224e7f811919c3b30ed81100d92164d8d7f438"}
Jul 06 02:44:18.316027 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:18.315999    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e" exitCode=0
Jul 06 02:44:18.316146 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:18.316082    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"}
Jul 06 02:44:18.330177 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:18.330129    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk" podStartSLOduration=2.320387449 podStartE2EDuration="4.330114571s" totalImagesPullingTime="2.009727122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:18.329542552 +0000 UTC m=+292.680744871" watchObservedRunningTime="2026-07-06 02:44:18.330114571 +0000 UTC m=+292.681316867"
Jul 06 02:44:19.325146 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:19.325092    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"}
Jul 06 02:44:19.325551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:19.325183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"}
Jul 06 02:44:19.325551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:19.325217    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"}
Jul 06 02:44:19.325551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:19.325252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"}
Jul 06 02:44:19.325551 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:19.325292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"}
Jul 06 02:44:21.339947 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:21.339890    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerStarted","Data":"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"}
Jul 06 02:44:21.367571 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:21.367373    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.700855082 podStartE2EDuration="10.367352245s" totalImagesPullingTime="5.651875293s" totalInitContainerRuntime="14.62187ms" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:21.364335049 +0000 UTC m=+295.715537373" watchObservedRunningTime="2026-07-06 02:44:21.367352245 +0000 UTC m=+295.718554545"
Jul 06 02:44:22.350284 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:22.350199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"}
Jul 06 02:44:22.350801 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:22.350286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"}
Jul 06 02:44:25.306907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:25.306883    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lhl65"
Jul 06 02:44:26.095099 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.095061    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:44:26.095637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.095615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:44:26.106938 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.106918    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 02:44:26.372859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.372775    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"}
Jul 06 02:44:26.372859 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.372845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"}
Jul 06 02:44:26.714539 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.372872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"}
Jul 06 02:44:26.714539 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.372900    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerStarted","Data":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"}
Jul 06 02:44:26.714539 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:26.400152    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.644679412 podStartE2EDuration="10.400129234s" totalImagesPullingTime="6.736632975s" totalInitContainerRuntime="18.816847ms" isStatefulPod=false podCreationTimestamp="2026-07-06 02:44:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:44:26.397227889 +0000 UTC m=+300.748430185" watchObservedRunningTime="2026-07-06 02:44:26.400129234 +0000 UTC m=+300.751331531"
Jul 06 02:44:27.038824 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:27.038739    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:44:35.187099 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:35.187053    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:35.187658 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:35.187131    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:37.417246 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:37.417208    2557 generic.go:356] "Generic (PLEG): container finished" podID="c1922c12-c653-4aa1-a60a-f317cf3e5eb6" containerID="b5e75ba3325945bc25072f5cc569dc922c2a4d44080910cb32e3cb63083a97a1" exitCode=0
Jul 06 02:44:37.417693 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:37.417280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx" event={"ID":"c1922c12-c653-4aa1-a60a-f317cf3e5eb6","Type":"ContainerDied","Data":"b5e75ba3325945bc25072f5cc569dc922c2a4d44080910cb32e3cb63083a97a1"}
Jul 06 02:44:37.417693 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:37.417677    2557 scope.go:117] "RemoveContainer" containerID="b5e75ba3325945bc25072f5cc569dc922c2a4d44080910cb32e3cb63083a97a1"
Jul 06 02:44:38.422941 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:38.422908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-9dkpx" event={"ID":"c1922c12-c653-4aa1-a60a-f317cf3e5eb6","Type":"ContainerStarted","Data":"9e4365f9c785a0925234d80c70c3c9ff337c0911a5a597829012d37b933c3885"}
Jul 06 02:44:55.191325 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:55.191296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:44:55.195146 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:44:55.195122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d7f67c9cf-88kjk"
Jul 06 02:45:17.038363 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:17.038324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:17.058574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:17.058549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:17.602651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:17.602625    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:30.861733 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.861701    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:30.862233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.861981    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="alertmanager" containerID="cri-o://743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99" gracePeriod=120
Jul 06 02:45:30.862233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.862057    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-metric" containerID="cri-o://6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9" gracePeriod=120
Jul 06 02:45:30.862233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.862076    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="prom-label-proxy" containerID="cri-o://5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d" gracePeriod=120
Jul 06 02:45:30.862233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.862098    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-web" containerID="cri-o://54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8" gracePeriod=120
Jul 06 02:45:30.862233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.862144    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy" containerID="cri-o://06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613" gracePeriod=120
Jul 06 02:45:30.862530 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:30.862149    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="config-reloader" containerID="cri-o://3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5" gracePeriod=120
Jul 06 02:45:31.643606 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643573    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d" exitCode=0
Jul 06 02:45:31.643606 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643598    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613" exitCode=0
Jul 06 02:45:31.643606 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643605    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5" exitCode=0
Jul 06 02:45:31.643606 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643614    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99" exitCode=0
Jul 06 02:45:31.643877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"}
Jul 06 02:45:31.643877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643703    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"}
Jul 06 02:45:31.643877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"}
Jul 06 02:45:31.643877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:31.643755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"}
Jul 06 02:45:32.112764 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.112742    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.193832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193756    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.193832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193788    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.193832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193842    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdk2b\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193873    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193912    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193939    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.193993    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194066    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194093 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194118    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config\") pod \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\" (UID: \"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75\") "
Jul 06 02:45:32.194578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194290    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:32.194578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194433    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.194578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194439    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:45:32.194922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.194861    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:32.196703 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.196676    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b" (OuterVolumeSpecName: "kube-api-access-vdk2b") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "kube-api-access-vdk2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:45:32.197161 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.197133    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.197238 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.197151    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out" (OuterVolumeSpecName: "config-out") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:45:32.197238 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.197187    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:45:32.197901 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.197875    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.198068 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.198039    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume" (OuterVolumeSpecName: "config-volume") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.198138 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.198070    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.198249 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.198228    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.201078 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.201053    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.208159 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.208138    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config" (OuterVolumeSpecName: "web-config") pod "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" (UID: "d4d8ed00-3c96-4a9d-b74b-5b28257d5d75"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:32.295068 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295042    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdk2b\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-kube-api-access-vdk2b\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295068 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295065    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295075    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295084    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-main-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295094    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-web-config\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295102    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-metrics-client-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295112    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295122    2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-volume\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295134    2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-cluster-tls-config\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295146    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-config-out\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295158    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-tls-assets\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.295235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.295169    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75-alertmanager-main-db\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:32.650337 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650306    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9" exitCode=0
Jul 06 02:45:32.650337 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650331    2557 generic.go:356] "Generic (PLEG): container finished" podID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerID="54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8" exitCode=0
Jul 06 02:45:32.650580 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650384    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.650580 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"}
Jul 06 02:45:32.650580 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"}
Jul 06 02:45:32.650580 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4d8ed00-3c96-4a9d-b74b-5b28257d5d75","Type":"ContainerDied","Data":"704b8481fbcf79c15738cbf383d574f35044ffe87d91a3dcc49df7ca0d4039af"}
Jul 06 02:45:32.650580 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.650530    2557 scope.go:117] "RemoveContainer" containerID="5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"
Jul 06 02:45:32.658917 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.658899    2557 scope.go:117] "RemoveContainer" containerID="6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"
Jul 06 02:45:32.665952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.665935    2557 scope.go:117] "RemoveContainer" containerID="06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"
Jul 06 02:45:32.670865 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.670844    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:32.675187 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.675164    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:32.675541 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.675525    2557 scope.go:117] "RemoveContainer" containerID="54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"
Jul 06 02:45:32.683182 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.683166    2557 scope.go:117] "RemoveContainer" containerID="3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"
Jul 06 02:45:32.689901 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.689885    2557 scope.go:117] "RemoveContainer" containerID="743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"
Jul 06 02:45:32.697150 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.697127    2557 scope.go:117] "RemoveContainer" containerID="ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"
Jul 06 02:45:32.703493 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.703464    2557 scope.go:117] "RemoveContainer" containerID="5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"
Jul 06 02:45:32.703757 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.703739    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d\": container with ID starting with 5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d not found: ID does not exist" containerID="5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"
Jul 06 02:45:32.703819 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.703779    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"} err="failed to get container status \"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d\": rpc error: code = NotFound desc = could not find container \"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d\": container with ID starting with 5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d not found: ID does not exist"
Jul 06 02:45:32.703819 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.703812    2557 scope.go:117] "RemoveContainer" containerID="6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"
Jul 06 02:45:32.704041 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.704022    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9\": container with ID starting with 6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9 not found: ID does not exist" containerID="6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"
Jul 06 02:45:32.704081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704047    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"} err="failed to get container status \"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9\": rpc error: code = NotFound desc = could not find container \"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9\": container with ID starting with 6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9 not found: ID does not exist"
Jul 06 02:45:32.704081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704063    2557 scope.go:117] "RemoveContainer" containerID="06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"
Jul 06 02:45:32.704273 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.704258    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613\": container with ID starting with 06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613 not found: ID does not exist" containerID="06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"
Jul 06 02:45:32.704311 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704278    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"} err="failed to get container status \"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613\": rpc error: code = NotFound desc = could not find container \"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613\": container with ID starting with 06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613 not found: ID does not exist"
Jul 06 02:45:32.704311 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704291    2557 scope.go:117] "RemoveContainer" containerID="54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"
Jul 06 02:45:32.704507 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.704491    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8\": container with ID starting with 54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8 not found: ID does not exist" containerID="54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"
Jul 06 02:45:32.704549 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704510    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"} err="failed to get container status \"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8\": rpc error: code = NotFound desc = could not find container \"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8\": container with ID starting with 54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8 not found: ID does not exist"
Jul 06 02:45:32.704549 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704524    2557 scope.go:117] "RemoveContainer" containerID="3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"
Jul 06 02:45:32.704744 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.704728    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5\": container with ID starting with 3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5 not found: ID does not exist" containerID="3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"
Jul 06 02:45:32.704778 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704748    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"} err="failed to get container status \"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5\": rpc error: code = NotFound desc = could not find container \"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5\": container with ID starting with 3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5 not found: ID does not exist"
Jul 06 02:45:32.704778 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704761    2557 scope.go:117] "RemoveContainer" containerID="743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"
Jul 06 02:45:32.704990 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.704975    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99\": container with ID starting with 743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99 not found: ID does not exist" containerID="743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"
Jul 06 02:45:32.705054 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.704992    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"} err="failed to get container status \"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99\": rpc error: code = NotFound desc = could not find container \"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99\": container with ID starting with 743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99 not found: ID does not exist"
Jul 06 02:45:32.705054 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.705004    2557 scope.go:117] "RemoveContainer" containerID="ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"
Jul 06 02:45:32.705404 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:32.705349    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5\": container with ID starting with ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5 not found: ID does not exist" containerID="ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"
Jul 06 02:45:32.705404 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.705392    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"} err="failed to get container status \"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5\": rpc error: code = NotFound desc = could not find container \"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5\": container with ID starting with ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5 not found: ID does not exist"
Jul 06 02:45:32.706702 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.705427    2557 scope.go:117] "RemoveContainer" containerID="5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"
Jul 06 02:45:32.706927 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.706873    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d"} err="failed to get container status \"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d\": rpc error: code = NotFound desc = could not find container \"5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d\": container with ID starting with 5c163437dbec1adfad8bea3392d857a873eb76592504d9b334872f641f387a7d not found: ID does not exist"
Jul 06 02:45:32.706927 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.706902    2557 scope.go:117] "RemoveContainer" containerID="6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"
Jul 06 02:45:32.707641 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707619    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:32.707731 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707664    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9"} err="failed to get container status \"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9\": rpc error: code = NotFound desc = could not find container \"6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9\": container with ID starting with 6ec5db9063c90b732de59e22b8b3668a570bf0257dd8dc02dc32ffc14df1f1d9 not found: ID does not exist"
Jul 06 02:45:32.707731 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707687    2557 scope.go:117] "RemoveContainer" containerID="06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"
Jul 06 02:45:32.707953 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707939    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="init-config-reloader"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707955    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="init-config-reloader"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707964    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707970    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707977    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="prom-label-proxy"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707983    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="prom-label-proxy"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707992    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-metric"
Jul 06 02:45:32.707996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707998    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-metric"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708008    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="alertmanager"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708014    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="alertmanager"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708021    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-web"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708026    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-web"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.707957    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613"} err="failed to get container status \"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613\": rpc error: code = NotFound desc = could not find container \"06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613\": container with ID starting with 06ee3fce001e1d2dd166507351c2ce00aa75628373d85641d5819aa9b9b14613 not found: ID does not exist"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708035    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="config-reloader"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="config-reloader"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708099    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-web"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708042    2557 scope.go:117] "RemoveContainer" containerID="54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708109    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy-metric"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708124    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="alertmanager"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708131    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="prom-label-proxy"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708138    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="config-reloader"
Jul 06 02:45:32.708206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708146    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" containerName="kube-rbac-proxy"
Jul 06 02:45:32.708792 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708390    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8"} err="failed to get container status \"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8\": rpc error: code = NotFound desc = could not find container \"54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8\": container with ID starting with 54e599d36130cdd20440fc0ecfe5f36486a7486d242d1162c3aa217f9efba0a8 not found: ID does not exist"
Jul 06 02:45:32.708792 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708413    2557 scope.go:117] "RemoveContainer" containerID="3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"
Jul 06 02:45:32.708792 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708684    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5"} err="failed to get container status \"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5\": rpc error: code = NotFound desc = could not find container \"3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5\": container with ID starting with 3f9df766100b2c7b00e6d38de096bed9a09971c26f7dab1315600b27bc8221f5 not found: ID does not exist"
Jul 06 02:45:32.708792 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708701    2557 scope.go:117] "RemoveContainer" containerID="743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"
Jul 06 02:45:32.708939 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708912    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99"} err="failed to get container status \"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99\": rpc error: code = NotFound desc = could not find container \"743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99\": container with ID starting with 743efeb071125fafb0e34bae68e08217d76ca4c1c949aae50d87b78a5216df99 not found: ID does not exist"
Jul 06 02:45:32.708939 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.708929    2557 scope.go:117] "RemoveContainer" containerID="ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"
Jul 06 02:45:32.709135 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.709119    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5"} err="failed to get container status \"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5\": rpc error: code = NotFound desc = could not find container \"ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5\": container with ID starting with ff4af1388db893ddcdfcdb9130a3b5fdeb9a66748221ca9abd60b0bfc3da58f5 not found: ID does not exist"
Jul 06 02:45:32.711244 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.711229    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.714942 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.714278    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 02:45:32.714942 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.714553    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pb6qt\""
Jul 06 02:45:32.714942 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.714724    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 02:45:32.714942 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.714871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 02:45:32.715164 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.715090    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 02:45:32.715164 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.715118    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 02:45:32.715267 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.715210    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 02:45:32.715352 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.715333    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 02:45:32.715534 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.715520    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 02:45:32.719211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.719193    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 02:45:32.728715 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.728695    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:32.799940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.799913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800061 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.799948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800061 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.799980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800061 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.799998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800061 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-web-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-out\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.800451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.800369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qc4p\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-kube-api-access-8qc4p\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-out\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901090    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qc4p\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-kube-api-access-8qc4p\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901296 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901696 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.901696 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.901345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-web-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.902599 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.902170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.903218 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.903180    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.904074 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.904048    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.904654 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.904557    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.905130 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.905105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-web-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.905233 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.905169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-out\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.905384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.905355    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.905843 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.905819    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.910542 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.906075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.910542 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.907637    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.910931 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.910903    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.911363 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.911346    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-config-volume\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:32.911875 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:32.911856    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qc4p\" (UniqueName: \"kubernetes.io/projected/54ee2462-13e4-48ac-bdee-11d3eeb2cbef-kube-api-access-8qc4p\") pod \"alertmanager-main-0\" (UID: \"54ee2462-13e4-48ac-bdee-11d3eeb2cbef\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:33.021484 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:33.021458    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 02:45:33.174545 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:33.173077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 02:45:33.656881 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:33.656840    2557 generic.go:356] "Generic (PLEG): container finished" podID="54ee2462-13e4-48ac-bdee-11d3eeb2cbef" containerID="a41a31803f43b23127abbacbedf5e70c6c165530a5690321d22d3a4cce156e8b" exitCode=0
Jul 06 02:45:33.657081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:33.656881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerDied","Data":"a41a31803f43b23127abbacbedf5e70c6c165530a5690321d22d3a4cce156e8b"}
Jul 06 02:45:33.657081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:33.656972    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"f1213d598895a06af21572f221635999b43d67bd98ba87f6dd2e021559b07117"}
Jul 06 02:45:34.229379 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.229351    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4d8ed00-3c96-4a9d-b74b-5b28257d5d75" path="/var/lib/kubelet/pods/d4d8ed00-3c96-4a9d-b74b-5b28257d5d75/volumes"
Jul 06 02:45:34.664715 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664632    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"810af59961b90f6aa1f8fa8726e21e481dd0620b7a8ece8839a50c53efd31047"}
Jul 06 02:45:34.664715 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664693    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"79f03874fc38fa5f9056886fec5d2360500d5e7c0c7b60597bbbb86909a504d2"}
Jul 06 02:45:34.664923 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664720    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"911b253e1dd61defb7775bb1f227e93ec6e6cdc926103e4fa69cbdd7a1733a41"}
Jul 06 02:45:34.664923 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"a6630979bad28db9c1f621aff448875ced91f27e19a9e25fa4d94a9631f385ab"}
Jul 06 02:45:34.664923 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"dfbede2fee2bff3f5ec77520f996d6bb071ab911e90e7c662107e58d1effcbe1"}
Jul 06 02:45:34.664923 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.664797    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54ee2462-13e4-48ac-bdee-11d3eeb2cbef","Type":"ContainerStarted","Data":"c12b8c6ba8c5e089584779194bd19fb8701bd87fd3a58e1c8afb60b720ea9ba7"}
Jul 06 02:45:34.689385 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:34.689336    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.669946828 podStartE2EDuration="2.689317691s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.370863ms" isStatefulPod=false podCreationTimestamp="2026-07-06 02:45:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:45:34.687695891 +0000 UTC m=+369.038898207" watchObservedRunningTime="2026-07-06 02:45:34.689317691 +0000 UTC m=+369.040519986"
Jul 06 02:45:35.085230 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085195    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:35.085578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085518    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="prometheus" containerID="cri-o://33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c" gracePeriod=600
Jul 06 02:45:35.085578 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085550    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="thanos-sidecar" containerID="cri-o://0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7" gracePeriod=600
Jul 06 02:45:35.085762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085581    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-web" containerID="cri-o://f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93" gracePeriod=600
Jul 06 02:45:35.085762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085548    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy" containerID="cri-o://f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3" gracePeriod=600
Jul 06 02:45:35.085762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085550    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="config-reloader" containerID="cri-o://d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5" gracePeriod=600
Jul 06 02:45:35.085762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.085586    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-thanos" containerID="cri-o://92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b" gracePeriod=600
Jul 06 02:45:35.344642 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.344582    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.426767 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426733    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426783    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426801    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426838    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.426940 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426903    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426940    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.426980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch5vb\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427011    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427044    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427097    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427120    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427145    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427167    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427189    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427185    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427194    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.427243 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427228    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427981 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427258    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427981 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427306    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle\") pod \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\" (UID: \"30f47cd1-5c8e-49e8-a52c-6af3062ee716\") "
Jul 06 02:45:35.427981 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427516    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.427981 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427777    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.427981 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.427884    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.428236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428088    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.428236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428111    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.428236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428127    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.428236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428162    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-configmap-metrics-client-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.428236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428177    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.429013 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.428979    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:45:35.429602 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.429573    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.430901 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.430873    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.430998    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431068    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431076    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431150    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431163    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431194 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431175    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431515 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431321    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431515 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431458    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config" (OuterVolumeSpecName: "config") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431670    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.431684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.431671    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out" (OuterVolumeSpecName: "config-out") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:45:35.432713 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.432692    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb" (OuterVolumeSpecName: "kube-api-access-ch5vb") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "kube-api-access-ch5vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:45:35.442201 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.442179    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config" (OuterVolumeSpecName: "web-config") pod "30f47cd1-5c8e-49e8-a52c-6af3062ee716" (UID: "30f47cd1-5c8e-49e8-a52c-6af3062ee716"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:45:35.528998 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.528960    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.528998 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.528997    2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.528998 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529006    2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-metrics-client-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529018    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config-out\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529027    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529036    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch5vb\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-kube-api-access-ch5vb\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529045    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529054    2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-grpc-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529062    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/30f47cd1-5c8e-49e8-a52c-6af3062ee716-tls-assets\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529070    2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-kube-rbac-proxy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529079    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-k8s-db\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529087    2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-config\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529095    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529103    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/30f47cd1-5c8e-49e8-a52c-6af3062ee716-web-config\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.529211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.529110    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30f47cd1-5c8e-49e8-a52c-6af3062ee716-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672520    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b" exitCode=0
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672551    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3" exitCode=0
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672561    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93" exitCode=0
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672569    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7" exitCode=0
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672576    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5" exitCode=0
Jul 06 02:45:35.672596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672584    2557 generic.go:356] "Generic (PLEG): container finished" podID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c" exitCode=0
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"}
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672676    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"}
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"}
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672801    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"}
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672824    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"}
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672816    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.672866 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672848    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"}
Jul 06 02:45:35.673161 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.672873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"30f47cd1-5c8e-49e8-a52c-6af3062ee716","Type":"ContainerDied","Data":"a081d9811b3d4f9b82d74f6251d1d6fc8e43eece85bee78cafd9c90cd7fbaa76"}
Jul 06 02:45:35.680949 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.680930    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.688342 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.688325    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.694841 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.694821    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.698160 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.698142    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:35.702513 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.702496    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.703375 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.703360    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:35.709059 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.709043    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.715929 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.715915    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.722522 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.722504    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.722748 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.722730    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.722794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.722758    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.722794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.722776    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.723005 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.722990    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.723048 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723008    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.723048 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723020    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.723253 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.723234    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.723303 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723258    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.723303 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723270    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.723530 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.723513    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.723587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723538    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.723587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723555    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.723799 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.723782    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.723846 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723804    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.723846 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.723820    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.724062 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.724044    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.724118 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724069    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.724118 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724089    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.724346 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:45:35.724330    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.724384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724358    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.724384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724371    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.724643 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724620    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.724643 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724642    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.724865 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724847    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.724914 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.724866    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.725084 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725067    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.725125 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725085    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.725290 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725274    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.725290 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725289    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.725518 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725500    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.725575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725519    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.725749 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725730    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.725787 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725749    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.726011 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.725996    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.726051 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726011    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.726222 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726205    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.726222 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726222    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.726419 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726404    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.726457 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726420    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.726728 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726708    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.726805 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726729    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.726996 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726973    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.727125 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.726997    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.727291 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727269    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.727352 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727294    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.727644 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727562    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.727644 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727600    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.727838 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727819    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.727890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.727839    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.728284    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.728314    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729113    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729504    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="config-reloader"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729519    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="config-reloader"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729541    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="init-config-reloader"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729549    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="init-config-reloader"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729557    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="prometheus"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729565    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="prometheus"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729580    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="thanos-sidecar"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729588    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="thanos-sidecar"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729597    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729603    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729617    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-thanos"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729625    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-thanos"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729635    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-web"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729642    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-web"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729707    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-web"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729718    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="prometheus"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729728    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="thanos-sidecar"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729736    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy-thanos"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729745    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="config-reloader"
Jul 06 02:45:35.730333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.729754    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" containerName="kube-rbac-proxy"
Jul 06 02:45:35.731567 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.730880    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.731567 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.730902    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.731757 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.731727    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.731862 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.731756    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.732069 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732041    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.732158 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732071    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.732392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732370    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.732450 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732394    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.732658 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732638    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.732658 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732657    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.732872 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732853    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.732922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.732873    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.733057 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733038    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.733097 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733057    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.733238 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733223    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.733275 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733238    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.733417 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733400    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.733458 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733418    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.733651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733635    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.733651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733650    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.733886 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733871    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.733929 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.733885    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.734090 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734072    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.734158 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734093    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.734317 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734301    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.734362 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734317    2557 scope.go:117] "RemoveContainer" containerID="92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"
Jul 06 02:45:35.734571 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734548    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b"} err="failed to get container status \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": rpc error: code = NotFound desc = could not find container \"92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b\": container with ID starting with 92a69117f8b8166f6a6112792143c2d973d7434e01f0aef765bb6c0d44015e6b not found: ID does not exist"
Jul 06 02:45:35.734571 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734565    2557 scope.go:117] "RemoveContainer" containerID="f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"
Jul 06 02:45:35.734818 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734790    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3"} err="failed to get container status \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": rpc error: code = NotFound desc = could not find container \"f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3\": container with ID starting with f19908d6d70e161187f69828514bd5da625ade81c6329e4661386a4a73b2e8c3 not found: ID does not exist"
Jul 06 02:45:35.734868 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734821    2557 scope.go:117] "RemoveContainer" containerID="f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"
Jul 06 02:45:35.734868 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.734831    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.735091 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735066    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93"} err="failed to get container status \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": rpc error: code = NotFound desc = could not find container \"f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93\": container with ID starting with f14e471e3882e0ea955538f6654baedf5c2ac3f6e24fc1a982480e9c85518a93 not found: ID does not exist"
Jul 06 02:45:35.735164 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735093    2557 scope.go:117] "RemoveContainer" containerID="0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"
Jul 06 02:45:35.735587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735560    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7"} err="failed to get container status \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": rpc error: code = NotFound desc = could not find container \"0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7\": container with ID starting with 0436beffc6bbc6dc43a7a22e64ca7f4865fc3e848a9a4d59c3fb5ea8966c84c7 not found: ID does not exist"
Jul 06 02:45:35.735663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735588    2557 scope.go:117] "RemoveContainer" containerID="d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"
Jul 06 02:45:35.735840 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735820    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5"} err="failed to get container status \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": rpc error: code = NotFound desc = could not find container \"d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5\": container with ID starting with d8a3420d89a8d63320f963981fad298c8910a76cdecf0b73a3a21478b78a85b5 not found: ID does not exist"
Jul 06 02:45:35.735884 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.735842    2557 scope.go:117] "RemoveContainer" containerID="33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"
Jul 06 02:45:35.736096 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.736079    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c"} err="failed to get container status \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": rpc error: code = NotFound desc = could not find container \"33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c\": container with ID starting with 33507c51754c29511069cf2af30b7b573b647682e6c8e7f745db08d1fdae869c not found: ID does not exist"
Jul 06 02:45:35.736144 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.736096    2557 scope.go:117] "RemoveContainer" containerID="54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"
Jul 06 02:45:35.736337 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.736318    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e"} err="failed to get container status \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": rpc error: code = NotFound desc = could not find container \"54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e\": container with ID starting with 54e5b0daceb7e83a0f900d530164bc5ac58d7657acc90bf493c592ca9a161c9e not found: ID does not exist"
Jul 06 02:45:35.737206 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.737192    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 02:45:35.737538 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.737520    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 02:45:35.737793 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.737779    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 02:45:35.738010 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.737994    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tsqjp\""
Jul 06 02:45:35.738082 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738064    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 02:45:35.738139 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738099    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 02:45:35.738139 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 02:45:35.738235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738075    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fpi899argkcc2\""
Jul 06 02:45:35.738235 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738064    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 02:45:35.738401 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738387    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 02:45:35.738656 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738616    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 02:45:35.738656 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738623    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 02:45:35.738858 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738626    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 02:45:35.738858 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.738648    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 02:45:35.740933 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.740916    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 02:45:35.743380 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.743360    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 02:45:35.747261 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.747242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:35.832288 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832441 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ndfw\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-kube-api-access-8ndfw\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832537    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832622    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832678    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832999 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832999 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.832999 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.832736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933675 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933675 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933675 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ndfw\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-kube-api-access-8ndfw\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.933899 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.933912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934248    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934315    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934349    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934607 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934386    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.934883 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.934616    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.935384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.935223    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.935747 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.935676    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.935881 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.935821    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.936588 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.936562    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.936887 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.936864    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.936962    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.937168    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.937227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.938369    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.938437    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.938490    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.938992 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.938975    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-config\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.939379 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.939360    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.939457 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.939388    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.940403 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.940385    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:35.941604 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:35.941588    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ndfw\" (UniqueName: \"kubernetes.io/projected/f5c2b119-fcf7-41a2-b405-e0c3296fd7d7-kube-api-access-8ndfw\") pod \"prometheus-k8s-0\" (UID: \"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:36.045150 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.045129    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:45:36.179574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.179538    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 02:45:36.182212 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:45:36.182182    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c2b119_fcf7_41a2_b405_e0c3296fd7d7.slice/crio-239c8d8fb8ef7f60cafd2cc4e4a310896bc86880a1e812d4c27aa8a46a4acc4c WatchSource:0}: Error finding container 239c8d8fb8ef7f60cafd2cc4e4a310896bc86880a1e812d4c27aa8a46a4acc4c: Status 404 returned error can't find the container with id 239c8d8fb8ef7f60cafd2cc4e4a310896bc86880a1e812d4c27aa8a46a4acc4c
Jul 06 02:45:36.230378 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.230346    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f47cd1-5c8e-49e8-a52c-6af3062ee716" path="/var/lib/kubelet/pods/30f47cd1-5c8e-49e8-a52c-6af3062ee716/volumes"
Jul 06 02:45:36.679113 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.679078    2557 generic.go:356] "Generic (PLEG): container finished" podID="f5c2b119-fcf7-41a2-b405-e0c3296fd7d7" containerID="909607f0dd3b42d5bcacf489efc9b26acb6914cdc801e611b1b510053b95fce5" exitCode=0
Jul 06 02:45:36.679592 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.679156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerDied","Data":"909607f0dd3b42d5bcacf489efc9b26acb6914cdc801e611b1b510053b95fce5"}
Jul 06 02:45:36.679592 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:36.679208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"239c8d8fb8ef7f60cafd2cc4e4a310896bc86880a1e812d4c27aa8a46a4acc4c"}
Jul 06 02:45:37.686840 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.686807    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"c0284017df7b06aaa4917ce74a64a4d91ebfbe0bd31e86bd05691b979bff634b"}
Jul 06 02:45:37.687216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.686901    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"685645a61b94cecd482dcc02f582cfd1e4af7603ea61d43b6c76fa81277601b5"}
Jul 06 02:45:37.687216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.686929    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"38e5b0a2d521d22148f8466ec756e53879dbfcf79d13c0748fe866565482e2bb"}
Jul 06 02:45:37.687216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.686953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"8a8763f618a5385f4a6f768b3e3532e0931283b196332223303ffa7fd6a14c70"}
Jul 06 02:45:37.687216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.686976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"1bb80e67f122778e975cd95259590246cf737b71b3c43279ce415d66af3948bd"}
Jul 06 02:45:37.687216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.687000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5c2b119-fcf7-41a2-b405-e0c3296fd7d7","Type":"ContainerStarted","Data":"066080cb404c7d84836b8fb4b5c89ff6e9510c01a6620a696d5dff9f539b72e2"}
Jul 06 02:45:37.716741 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:37.716691    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6984411120000003 podStartE2EDuration="2.716675484s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.234372ms" isStatefulPod=false podCreationTimestamp="2026-07-06 02:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:45:37.714174146 +0000 UTC m=+372.065376478" watchObservedRunningTime="2026-07-06 02:45:37.716675484 +0000 UTC m=+372.067877780"
Jul 06 02:45:41.045624 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:45:41.045581    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:46:36.045312 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:46:36.045281    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:46:36.060678 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:46:36.060652    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:46:36.943890 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:46:36.943863    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 02:47:24.598406 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.598370    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"]
Jul 06 02:47:24.601737 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.601719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.604115 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.604092    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 02:47:24.604258 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.604091    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 02:47:24.604336 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.604272    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 02:47:24.604433 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.604410    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-22csz\""
Jul 06 02:47:24.604544 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.604528    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 02:47:24.621896 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.621872    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"]
Jul 06 02:47:24.643848 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.643825    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.643951 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.643889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.644004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.643944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.644004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.643970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.644004 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.643996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldw9\" (UniqueName: \"kubernetes.io/projected/37e34e97-a971-4ac6-a626-2b71ecea44c7-kube-api-access-kldw9\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.744853 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.744818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.744853 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.744855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.745056 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.744875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.745056 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.744900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldw9\" (UniqueName: \"kubernetes.io/projected/37e34e97-a971-4ac6-a626-2b71ecea44c7-kube-api-access-kldw9\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.745056 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.744937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.745214 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.745196    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-manifests\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.747256 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.747233    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37e34e97-a971-4ac6-a626-2b71ecea44c7-tmp\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.747463 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.747447    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.747526 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.747467    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/37e34e97-a971-4ac6-a626-2b71ecea44c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.755328 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.755309    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldw9\" (UniqueName: \"kubernetes.io/projected/37e34e97-a971-4ac6-a626-2b71ecea44c7-kube-api-access-kldw9\") pod \"opendatahub-operator-controller-manager-6d49d64447-xfgqr\" (UID: \"37e34e97-a971-4ac6-a626-2b71ecea44c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:24.912177 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:24.912093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:25.043586 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:25.043555    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"]
Jul 06 02:47:25.048169 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:47:25.048140    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e34e97_a971_4ac6_a626_2b71ecea44c7.slice/crio-272a06e4e765595af3379d8695f64e1091db589a321b2e976cb4fa8727f25fb3 WatchSource:0}: Error finding container 272a06e4e765595af3379d8695f64e1091db589a321b2e976cb4fa8727f25fb3: Status 404 returned error can't find the container with id 272a06e4e765595af3379d8695f64e1091db589a321b2e976cb4fa8727f25fb3
Jul 06 02:47:25.050560 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:25.050544    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:47:25.117828 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:25.117794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr" event={"ID":"37e34e97-a971-4ac6-a626-2b71ecea44c7","Type":"ContainerStarted","Data":"272a06e4e765595af3379d8695f64e1091db589a321b2e976cb4fa8727f25fb3"}
Jul 06 02:47:29.138199 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:29.138165    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr" event={"ID":"37e34e97-a971-4ac6-a626-2b71ecea44c7","Type":"ContainerStarted","Data":"61a50b5de8a8a5160d66dcb60ee451c72a4c4ecd0a10fac336703e117292d50a"}
Jul 06 02:47:30.143804 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:30.143765    2557 generic.go:356] "Generic (PLEG): container finished" podID="37e34e97-a971-4ac6-a626-2b71ecea44c7" containerID="61a50b5de8a8a5160d66dcb60ee451c72a4c4ecd0a10fac336703e117292d50a" exitCode=0
Jul 06 02:47:30.144507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:30.143812    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr" event={"ID":"37e34e97-a971-4ac6-a626-2b71ecea44c7","Type":"ContainerDied","Data":"61a50b5de8a8a5160d66dcb60ee451c72a4c4ecd0a10fac336703e117292d50a"}
Jul 06 02:47:31.150339 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:31.150309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr" event={"ID":"37e34e97-a971-4ac6-a626-2b71ecea44c7","Type":"ContainerStarted","Data":"46f57e0cf29c41d3e156d9ab9b1bfa89eb995cefd03e2f5ec36583cab39645bf"}
Jul 06 02:47:31.150741 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:31.150546    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:31.177420 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:31.177375    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr" podStartSLOduration=2.712810111 podStartE2EDuration="7.177362168s" totalImagesPullingTime="3.395248455s" totalInitContainerRuntime="1.069303602s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:31.174866751 +0000 UTC m=+485.526069081" watchObservedRunningTime="2026-07-06 02:47:31.177362168 +0000 UTC m=+485.528564512"
Jul 06 02:47:42.157257 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:42.157219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d49d64447-xfgqr"
Jul 06 02:47:51.929346 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.929304    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"]
Jul 06 02:47:51.932586 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.932557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:51.935186 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.935165    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 02:47:51.935307 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.935165    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6nprl\""
Jul 06 02:47:51.935307 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.935223    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 02:47:51.935559 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.935542    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 02:47:51.944054 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:51.944034    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"]
Jul 06 02:47:52.068052 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068191 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068191 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493e0399-4083-456e-a27e-f466721d2ace-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068191 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493e0399-4083-456e-a27e-f466721d2ace-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068312 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068206    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068312 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068312 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068312 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-kube-api-access-mq9f7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.068451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.068315    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169217 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-kube-api-access-mq9f7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169373    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493e0399-4083-456e-a27e-f466721d2ace-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.169662 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.169580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493e0399-4083-456e-a27e-f466721d2ace-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.170222 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.170175    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.170339 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.170226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.170507 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.170463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.170609 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.170504    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/493e0399-4083-456e-a27e-f466721d2ace-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.170609 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.170535    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.172088 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.172063    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/493e0399-4083-456e-a27e-f466721d2ace-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.172192 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.172158    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/493e0399-4083-456e-a27e-f466721d2ace-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.181889 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.181841    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.185524 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.185505    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9f7\" (UniqueName: \"kubernetes.io/projected/493e0399-4083-456e-a27e-f466721d2ace-kube-api-access-mq9f7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dsvwz\" (UID: \"493e0399-4083-456e-a27e-f466721d2ace\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.244980 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.244952    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:52.396043 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:52.396010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"]
Jul 06 02:47:52.399142 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:47:52.399114    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493e0399_4083_456e_a27e_f466721d2ace.slice/crio-1b723fd8f23d0954fbffeb062de2fac122365a014f1685cbc6be3164ffd177ed WatchSource:0}: Error finding container 1b723fd8f23d0954fbffeb062de2fac122365a014f1685cbc6be3164ffd177ed: Status 404 returned error can't find the container with id 1b723fd8f23d0954fbffeb062de2fac122365a014f1685cbc6be3164ffd177ed
Jul 06 02:47:53.244333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:53.244292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz" event={"ID":"493e0399-4083-456e-a27e-f466721d2ace","Type":"ContainerStarted","Data":"1b723fd8f23d0954fbffeb062de2fac122365a014f1685cbc6be3164ffd177ed"}
Jul 06 02:47:54.061161 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.061127    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"]
Jul 06 02:47:54.064461 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.064441    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.067511 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.067487    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 02:47:54.068395 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.068376    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 02:47:54.068556 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.068408    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 02:47:54.068556 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.068410    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 02:47:54.068805 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.068782    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qpsm2\""
Jul 06 02:47:54.069064 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.069046    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 02:47:54.082651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.082631    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"]
Jul 06 02:47:54.190229 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.190199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.190371 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.190238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.190371 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.190339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bs4l\" (UniqueName: \"kubernetes.io/projected/ba32606d-6281-48fb-bb75-8dcb0ba8538b-kube-api-access-4bs4l\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.190451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.190375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba32606d-6281-48fb-bb75-8dcb0ba8538b-manager-config\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.291267 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.291237    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.291647 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.291277    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.291647 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.291334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bs4l\" (UniqueName: \"kubernetes.io/projected/ba32606d-6281-48fb-bb75-8dcb0ba8538b-kube-api-access-4bs4l\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.291647 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.291356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba32606d-6281-48fb-bb75-8dcb0ba8538b-manager-config\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.292053 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.292035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ba32606d-6281-48fb-bb75-8dcb0ba8538b-manager-config\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.293744 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.293721    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.293846 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.293782    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba32606d-6281-48fb-bb75-8dcb0ba8538b-metrics-cert\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.300741 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.300718    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bs4l\" (UniqueName: \"kubernetes.io/projected/ba32606d-6281-48fb-bb75-8dcb0ba8538b-kube-api-access-4bs4l\") pod \"lws-controller-manager-56497ccf4b-bf26c\" (UID: \"ba32606d-6281-48fb-bb75-8dcb0ba8538b\") " pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.374445 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.374368    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:47:54.512350 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:54.512326    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"]
Jul 06 02:47:54.514432 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:47:54.514398    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba32606d_6281_48fb_bb75_8dcb0ba8538b.slice/crio-52b15939e61933d4d75884df313240ce2ea67bae2f61352a1c6dad5b723a966a WatchSource:0}: Error finding container 52b15939e61933d4d75884df313240ce2ea67bae2f61352a1c6dad5b723a966a: Status 404 returned error can't find the container with id 52b15939e61933d4d75884df313240ce2ea67bae2f61352a1c6dad5b723a966a
Jul 06 02:47:55.255451 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.255418    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c" event={"ID":"ba32606d-6281-48fb-bb75-8dcb0ba8538b","Type":"ContainerStarted","Data":"52b15939e61933d4d75884df313240ce2ea67bae2f61352a1c6dad5b723a966a"}
Jul 06 02:47:55.769569 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.769535    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"]
Jul 06 02:47:55.776932 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.776902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:55.779510 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.779436    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 02:47:55.779932 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.779456    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gfrzh\""
Jul 06 02:47:55.782946 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.782885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"]
Jul 06 02:47:55.909808 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.909668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:55.909808 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:55.909714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76cs\" (UniqueName: \"kubernetes.io/projected/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-kube-api-access-k76cs\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.010765 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.010724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.010955 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.010773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76cs\" (UniqueName: \"kubernetes.io/projected/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-kube-api-access-k76cs\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.010955 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:47:56.010892    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 02:47:56.011067 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:47:56.010971    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert podName:7743ee66-c11d-4c09-ba3f-b7d25482ebf8 nodeName:}" failed. No retries permitted until 2026-07-06 02:47:56.510948973 +0000 UTC m=+510.862151252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert") pod "kserve-controller-manager-d6f4b65b8-mh5n5" (UID: "7743ee66-c11d-4c09-ba3f-b7d25482ebf8") : secret "kserve-webhook-server-cert" not found
Jul 06 02:47:56.025427 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.025359    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76cs\" (UniqueName: \"kubernetes.io/projected/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-kube-api-access-k76cs\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.439335 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.439298    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:47:56.439413 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.439375    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:47:56.439413 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.439406    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:47:56.515775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.515746    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.518698 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.518671    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7743ee66-c11d-4c09-ba3f-b7d25482ebf8-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh5n5\" (UID: \"7743ee66-c11d-4c09-ba3f-b7d25482ebf8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.692740 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.692642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:47:56.867128 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:56.867102    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"]
Jul 06 02:47:56.870058 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:47:56.870027    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7743ee66_c11d_4c09_ba3f_b7d25482ebf8.slice/crio-8d722e703e1edd4381e615e5ee31cb57239a8cb50c1902ab5a91e5326618cf86 WatchSource:0}: Error finding container 8d722e703e1edd4381e615e5ee31cb57239a8cb50c1902ab5a91e5326618cf86: Status 404 returned error can't find the container with id 8d722e703e1edd4381e615e5ee31cb57239a8cb50c1902ab5a91e5326618cf86
Jul 06 02:47:57.266264 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:57.266227    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5" event={"ID":"7743ee66-c11d-4c09-ba3f-b7d25482ebf8","Type":"ContainerStarted","Data":"8d722e703e1edd4381e615e5ee31cb57239a8cb50c1902ab5a91e5326618cf86"}
Jul 06 02:47:57.267588 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:57.267560    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz" event={"ID":"493e0399-4083-456e-a27e-f466721d2ace","Type":"ContainerStarted","Data":"0e3f06b66a9270ca47025f339deaa72d9f4aff49534d8520364e83ea17401190"}
Jul 06 02:47:57.289749 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:57.289645    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz" podStartSLOduration=2.251793389 podStartE2EDuration="6.289625752s" totalImagesPullingTime="4.037832363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:47:57.28814499 +0000 UTC m=+511.639347311" watchObservedRunningTime="2026-07-06 02:47:57.289625752 +0000 UTC m=+511.640828049"
Jul 06 02:47:58.245333 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:58.245301    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:58.250834 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:58.250812    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:58.275227 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:58.275199    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:47:58.276341 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:47:58.276316    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dsvwz"
Jul 06 02:48:00.285307 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.285267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5" event={"ID":"7743ee66-c11d-4c09-ba3f-b7d25482ebf8","Type":"ContainerStarted","Data":"64f2d7bd62b2cc7fca1640535c35ea9fa70965741655b52d706bd7267fb9f228"}
Jul 06 02:48:00.285777 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.285339    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:48:00.286906 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.286876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c" event={"ID":"ba32606d-6281-48fb-bb75-8dcb0ba8538b","Type":"ContainerStarted","Data":"f637ce9a718f324a94a0dafcb9303c8059b93abb82086325de5526fe3602cb1a"}
Jul 06 02:48:00.287033 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.286984    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:48:00.302943 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.302896    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5" podStartSLOduration=2.3054590409999998 podStartE2EDuration="5.302878238s" totalImagesPullingTime="2.997419197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:48:00.300326199 +0000 UTC m=+514.651528495" watchObservedRunningTime="2026-07-06 02:48:00.302878238 +0000 UTC m=+514.654080536"
Jul 06 02:48:00.316223 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:00.316182    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c" podStartSLOduration=0.963715655 podStartE2EDuration="6.316169425s" totalImagesPullingTime="5.35245377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:48:00.315115367 +0000 UTC m=+514.666317691" watchObservedRunningTime="2026-07-06 02:48:00.316169425 +0000 UTC m=+514.667371720"
Jul 06 02:48:11.293058 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:11.293023    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56497ccf4b-bf26c"
Jul 06 02:48:31.295054 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:31.295026    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh5n5"
Jul 06 02:48:45.430688 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.430649    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:45.437928 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.437903    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:45.441273 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.441243    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 02:48:45.441460 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.441244    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ws4np\""
Jul 06 02:48:45.441699 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.441672    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 02:48:45.442372 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.442314    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:45.534346 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.534313    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd6s5\" (UniqueName: \"kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5\") pod \"kuadrant-operator-catalog-9ndkc\" (UID: \"e51bebd9-2ced-4530-b155-eefc0edf3ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:45.635527 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.635492    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd6s5\" (UniqueName: \"kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5\") pod \"kuadrant-operator-catalog-9ndkc\" (UID: \"e51bebd9-2ced-4530-b155-eefc0edf3ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:45.643339 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.643322    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd6s5\" (UniqueName: \"kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5\") pod \"kuadrant-operator-catalog-9ndkc\" (UID: \"e51bebd9-2ced-4530-b155-eefc0edf3ba6\") " pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:45.748667 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.748638    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:45.804844 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.804812    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:45.873977 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:45.873869    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:45.876233 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:48:45.876208    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51bebd9_2ced_4530_b155_eefc0edf3ba6.slice/crio-e0dd837ca9e6fca011f5ee126c454598a27751103d615f9fe0c7995227d0fb2e WatchSource:0}: Error finding container e0dd837ca9e6fca011f5ee126c454598a27751103d615f9fe0c7995227d0fb2e: Status 404 returned error can't find the container with id e0dd837ca9e6fca011f5ee126c454598a27751103d615f9fe0c7995227d0fb2e
Jul 06 02:48:46.014944 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.014874    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lhn5f"]
Jul 06 02:48:46.017667 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.017648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:46.025745 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.025721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lhn5f"]
Jul 06 02:48:46.140846 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.140818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6lc\" (UniqueName: \"kubernetes.io/projected/128adbf2-4dbd-4592-95c1-3f3e52e600b7-kube-api-access-2q6lc\") pod \"kuadrant-operator-catalog-lhn5f\" (UID: \"128adbf2-4dbd-4592-95c1-3f3e52e600b7\") " pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:46.241836 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.241799    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6lc\" (UniqueName: \"kubernetes.io/projected/128adbf2-4dbd-4592-95c1-3f3e52e600b7-kube-api-access-2q6lc\") pod \"kuadrant-operator-catalog-lhn5f\" (UID: \"128adbf2-4dbd-4592-95c1-3f3e52e600b7\") " pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:46.255574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.255544    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6lc\" (UniqueName: \"kubernetes.io/projected/128adbf2-4dbd-4592-95c1-3f3e52e600b7-kube-api-access-2q6lc\") pod \"kuadrant-operator-catalog-lhn5f\" (UID: \"128adbf2-4dbd-4592-95c1-3f3e52e600b7\") " pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:46.327515 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.327433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:46.467980 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.467782    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lhn5f"]
Jul 06 02:48:46.477018 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:48:46.476990    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128adbf2_4dbd_4592_95c1_3f3e52e600b7.slice/crio-a3ac7c1610fdf81d9e88720947a38309b93430d2d649bda3a6e0c48618922191 WatchSource:0}: Error finding container a3ac7c1610fdf81d9e88720947a38309b93430d2d649bda3a6e0c48618922191: Status 404 returned error can't find the container with id a3ac7c1610fdf81d9e88720947a38309b93430d2d649bda3a6e0c48618922191
Jul 06 02:48:46.488060 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.488034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" event={"ID":"e51bebd9-2ced-4530-b155-eefc0edf3ba6","Type":"ContainerStarted","Data":"e0dd837ca9e6fca011f5ee126c454598a27751103d615f9fe0c7995227d0fb2e"}
Jul 06 02:48:46.489222 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:46.489198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f" event={"ID":"128adbf2-4dbd-4592-95c1-3f3e52e600b7","Type":"ContainerStarted","Data":"a3ac7c1610fdf81d9e88720947a38309b93430d2d649bda3a6e0c48618922191"}
Jul 06 02:48:48.501880 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.501840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" event={"ID":"e51bebd9-2ced-4530-b155-eefc0edf3ba6","Type":"ContainerStarted","Data":"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"}
Jul 06 02:48:48.502349 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.501869    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" podUID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" containerName="registry-server" containerID="cri-o://0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5" gracePeriod=2
Jul 06 02:48:48.503421 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.503393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f" event={"ID":"128adbf2-4dbd-4592-95c1-3f3e52e600b7","Type":"ContainerStarted","Data":"3592a1f05b30c529aff831861fe5b2ae107a86902e8072179a9030988cb2ebec"}
Jul 06 02:48:48.518084 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.518048    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" podStartSLOduration=1.623155793 podStartE2EDuration="3.518035101s" totalImagesPullingTime="1.894879308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:48:48.517109368 +0000 UTC m=+562.868311688" watchObservedRunningTime="2026-07-06 02:48:48.518035101 +0000 UTC m=+562.869237397"
Jul 06 02:48:48.532811 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.532775    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f" podStartSLOduration=2.23797806 podStartE2EDuration="3.532762298s" totalImagesPullingTime="1.294784238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:48:48.531381165 +0000 UTC m=+562.882583462" watchObservedRunningTime="2026-07-06 02:48:48.532762298 +0000 UTC m=+562.883964594"
Jul 06 02:48:48.748780 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.747772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:48.863834 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.863742    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd6s5\" (UniqueName: \"kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5\") pod \"e51bebd9-2ced-4530-b155-eefc0edf3ba6\" (UID: \"e51bebd9-2ced-4530-b155-eefc0edf3ba6\") "
Jul 06 02:48:48.865934 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.865902    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5" (OuterVolumeSpecName: "kube-api-access-zd6s5") pod "e51bebd9-2ced-4530-b155-eefc0edf3ba6" (UID: "e51bebd9-2ced-4530-b155-eefc0edf3ba6"). InnerVolumeSpecName "kube-api-access-zd6s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:48:48.964514 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:48.964465    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd6s5\" (UniqueName: \"kubernetes.io/projected/e51bebd9-2ced-4530-b155-eefc0edf3ba6-kube-api-access-zd6s5\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:48:49.508985 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.508948    2557 generic.go:356] "Generic (PLEG): container finished" podID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" containerID="0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5" exitCode=0
Jul 06 02:48:49.509387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.508993    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc"
Jul 06 02:48:49.509387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.509039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" event={"ID":"e51bebd9-2ced-4530-b155-eefc0edf3ba6","Type":"ContainerDied","Data":"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"}
Jul 06 02:48:49.509387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.509086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9ndkc" event={"ID":"e51bebd9-2ced-4530-b155-eefc0edf3ba6","Type":"ContainerDied","Data":"e0dd837ca9e6fca011f5ee126c454598a27751103d615f9fe0c7995227d0fb2e"}
Jul 06 02:48:49.509387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.509115    2557 scope.go:117] "RemoveContainer" containerID="0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"
Jul 06 02:48:49.517747 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.517730    2557 scope.go:117] "RemoveContainer" containerID="0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"
Jul 06 02:48:49.518000 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:48:49.517982    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5\": container with ID starting with 0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5 not found: ID does not exist" containerID="0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"
Jul 06 02:48:49.518068 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.518013    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5"} err="failed to get container status \"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5\": rpc error: code = NotFound desc = could not find container \"0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5\": container with ID starting with 0af1f39f29452214081524ab0bd2f7d200518c43024f16e98cb748cd45f476b5 not found: ID does not exist"
Jul 06 02:48:49.530356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.530335    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:49.531872 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:49.531854    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9ndkc"]
Jul 06 02:48:50.229444 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:50.229412    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" path="/var/lib/kubelet/pods/e51bebd9-2ced-4530-b155-eefc0edf3ba6/volumes"
Jul 06 02:48:56.327880 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:56.327848    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:56.328279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:56.327901    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:56.349634 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:56.349611    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:48:56.562147 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:48:56.562122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lhn5f"
Jul 06 02:49:16.750794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.750760    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"]
Jul 06 02:49:16.751237 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.751132    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" containerName="registry-server"
Jul 06 02:49:16.751237 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.751144    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" containerName="registry-server"
Jul 06 02:49:16.751237 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.751216    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e51bebd9-2ced-4530-b155-eefc0edf3ba6" containerName="registry-server"
Jul 06 02:49:16.757478 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.757458    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:16.760157 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.760136    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wbk99\""
Jul 06 02:49:16.760293 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.760189    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 02:49:16.764642 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.764617    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"]
Jul 06 02:49:16.791999 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.791972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd24g\" (UniqueName: \"kubernetes.io/projected/ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a-kube-api-access-cd24g\") pod \"dns-operator-controller-manager-864dd78c4c-wpxhw\" (UID: \"ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:16.892863 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.892836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd24g\" (UniqueName: \"kubernetes.io/projected/ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a-kube-api-access-cd24g\") pod \"dns-operator-controller-manager-864dd78c4c-wpxhw\" (UID: \"ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:16.900931 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:16.900908    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd24g\" (UniqueName: \"kubernetes.io/projected/ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a-kube-api-access-cd24g\") pod \"dns-operator-controller-manager-864dd78c4c-wpxhw\" (UID: \"ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:17.068651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:17.068567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:17.203930 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:17.203895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"]
Jul 06 02:49:17.206233 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:49:17.206206    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef08fe57_ac7e_46b2_a24a_c7390cdc1b2a.slice/crio-b2e443670fbf641b24b23b7d91f12e52ec6bc42717b136b16dc758c86b1aedf4 WatchSource:0}: Error finding container b2e443670fbf641b24b23b7d91f12e52ec6bc42717b136b16dc758c86b1aedf4: Status 404 returned error can't find the container with id b2e443670fbf641b24b23b7d91f12e52ec6bc42717b136b16dc758c86b1aedf4
Jul 06 02:49:17.639021 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:17.638993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw" event={"ID":"ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a","Type":"ContainerStarted","Data":"b2e443670fbf641b24b23b7d91f12e52ec6bc42717b136b16dc758c86b1aedf4"}
Jul 06 02:49:19.649684 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:19.649647    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw" event={"ID":"ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a","Type":"ContainerStarted","Data":"45a773dc0dcaca9304a72bb014755df329b3889ac88ace902a5a2e60b2c3c629"}
Jul 06 02:49:19.650088 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:19.649718    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:19.667076 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:19.667022    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw" podStartSLOduration=1.853305168 podStartE2EDuration="3.66700708s" totalImagesPullingTime="1.813701912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:19.664950582 +0000 UTC m=+594.016152879" watchObservedRunningTime="2026-07-06 02:49:19.66700708 +0000 UTC m=+594.018209375"
Jul 06 02:49:24.067865 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.067833    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"]
Jul 06 02:49:24.073694 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.073672    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:24.076489 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.076454    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jrtmq\""
Jul 06 02:49:24.086817 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.086798    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"]
Jul 06 02:49:24.155870 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.155840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppq5h\" (UniqueName: \"kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h\") pod \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" (UID: \"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:24.257051 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.257019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppq5h\" (UniqueName: \"kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h\") pod \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" (UID: \"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:24.269463 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.269434    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppq5h\" (UniqueName: \"kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h\") pod \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" (UID: \"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:24.383877 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.383823    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:24.542485 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.542453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"]
Jul 06 02:49:24.545116 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:49:24.545087    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3720b8bc_7b19_4bc4_9b9d_16a5aeadf8e8.slice/crio-5817308de67e455c2bdd8067097ad45ced17f77440db1979c5ccd5c81138f1e7 WatchSource:0}: Error finding container 5817308de67e455c2bdd8067097ad45ced17f77440db1979c5ccd5c81138f1e7: Status 404 returned error can't find the container with id 5817308de67e455c2bdd8067097ad45ced17f77440db1979c5ccd5c81138f1e7
Jul 06 02:49:24.674711 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:24.674638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj" event={"ID":"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8","Type":"ContainerStarted","Data":"5817308de67e455c2bdd8067097ad45ced17f77440db1979c5ccd5c81138f1e7"}
Jul 06 02:49:26.136090 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:26.136062    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:49:26.138309 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:26.138287    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:49:26.687341 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:26.687301    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj" event={"ID":"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8","Type":"ContainerStarted","Data":"42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253"}
Jul 06 02:49:26.689283 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:26.687437    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:26.704216 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:26.704170    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj" podStartSLOduration=1.181709584 podStartE2EDuration="2.704155463s" totalImagesPullingTime="1.522445879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:26.703504138 +0000 UTC m=+601.054706456" watchObservedRunningTime="2026-07-06 02:49:26.704155463 +0000 UTC m=+601.055357761"
Jul 06 02:49:28.793405 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.793329    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"]
Jul 06 02:49:28.796617 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.796597    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:28.798774 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.798754    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f7szv\""
Jul 06 02:49:28.808096 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.808077    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"]
Jul 06 02:49:28.896509 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.896460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bkp\" (UniqueName: \"kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:28.896615 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.896525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:28.997220 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.997195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bkp\" (UniqueName: \"kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:28.997330 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.997231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:28.997561 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:28.997547    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:29.008059 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:29.008038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bkp\" (UniqueName: \"kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:29.107176 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:29.107112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:29.240105 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:29.240082    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"]
Jul 06 02:49:29.242231 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:49:29.242209    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ea508f_97be_4afe_be7b_29853c6116d0.slice/crio-b7e7e0cd0e69ed98d8cee91475a78505abcaf23f87a46f4d5cd7580e393a6f4e WatchSource:0}: Error finding container b7e7e0cd0e69ed98d8cee91475a78505abcaf23f87a46f4d5cd7580e393a6f4e: Status 404 returned error can't find the container with id b7e7e0cd0e69ed98d8cee91475a78505abcaf23f87a46f4d5cd7580e393a6f4e
Jul 06 02:49:29.700856 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:29.700822    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84" event={"ID":"e9ea508f-97be-4afe-be7b-29853c6116d0","Type":"ContainerStarted","Data":"b7e7e0cd0e69ed98d8cee91475a78505abcaf23f87a46f4d5cd7580e393a6f4e"}
Jul 06 02:49:30.656762 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:30.656730    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wpxhw"
Jul 06 02:49:33.724164 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:33.724122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84" event={"ID":"e9ea508f-97be-4afe-be7b-29853c6116d0","Type":"ContainerStarted","Data":"c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1"}
Jul 06 02:49:33.724558 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:33.724184    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:33.742467 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:33.742422    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84" podStartSLOduration=1.6967061380000001 podStartE2EDuration="5.742407116s" totalImagesPullingTime="4.045700978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:33.741040883 +0000 UTC m=+608.092243179" watchObservedRunningTime="2026-07-06 02:49:33.742407116 +0000 UTC m=+608.093609411"
Jul 06 02:49:37.692941 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:37.692907    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:44.731695 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:44.731662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.369844 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.369811    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"]
Jul 06 02:49:46.370221 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.370007    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" containerName="manager" containerID="cri-o://c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1" gracePeriod=2
Jul 06 02:49:46.372601 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.372498    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.373752 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.373697    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"]
Jul 06 02:49:46.384058 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.384032    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"]
Jul 06 02:49:46.384266 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.384243    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" containerName="manager" containerID="cri-o://42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253" gracePeriod=2
Jul 06 02:49:46.398360 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.398310    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:49:46.399016 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.398895    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" containerName="manager"
Jul 06 02:49:46.399016 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.398912    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" containerName="manager"
Jul 06 02:49:46.399016 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.398985    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" containerName="manager"
Jul 06 02:49:46.402085 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.402067    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"]
Jul 06 02:49:46.402195 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.402146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.405538 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.405507    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mhwvj\": pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.407799 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.407764    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.409953 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.409921    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.411428 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.411407    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"]
Jul 06 02:49:46.411769 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.411755    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" containerName="manager"
Jul 06 02:49:46.411845 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.411771    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" containerName="manager"
Jul 06 02:49:46.411898 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.411857    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" containerName="manager"
Jul 06 02:49:46.414729 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.414713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:46.420151 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.420129    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:49:46.425080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.425047    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"]
Jul 06 02:49:46.435216 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.435190    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.453522 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.453498    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.455237 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.455219    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.556209 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.556169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gq7g\" (UniqueName: \"kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.556362 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.556238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.556362 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.556317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gkvp\" (UniqueName: \"kubernetes.io/projected/74c5fc1f-4930-47d0-b184-5f9421367af2-kube-api-access-9gkvp\") pod \"limitador-operator-controller-manager-859d7b78bd-88rnd\" (UID: \"74c5fc1f-4930-47d0-b184-5f9421367af2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:46.626637 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.626584    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.628761 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.628734    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.629086 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.629070    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.630598 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.630575    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.632540 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.632516    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.634432 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.634412    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.657442 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.657413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gq7g\" (UniqueName: \"kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.657575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.657458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.657575 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.657559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gkvp\" (UniqueName: \"kubernetes.io/projected/74c5fc1f-4930-47d0-b184-5f9421367af2-kube-api-access-9gkvp\") pod \"limitador-operator-controller-manager-859d7b78bd-88rnd\" (UID: \"74c5fc1f-4930-47d0-b184-5f9421367af2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:46.657905 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.657885    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.668104 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.668077    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gkvp\" (UniqueName: \"kubernetes.io/projected/74c5fc1f-4930-47d0-b184-5f9421367af2-kube-api-access-9gkvp\") pod \"limitador-operator-controller-manager-859d7b78bd-88rnd\" (UID: \"74c5fc1f-4930-47d0-b184-5f9421367af2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:46.668722 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.668706    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gq7g\" (UniqueName: \"kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cj9m4\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.758078 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.758051    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppq5h\" (UniqueName: \"kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h\") pod \"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\" (UID: \"3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8\") "
Jul 06 02:49:46.758178 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.758091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8bkp\" (UniqueName: \"kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp\") pod \"e9ea508f-97be-4afe-be7b-29853c6116d0\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") "
Jul 06 02:49:46.758240 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.758220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume\") pod \"e9ea508f-97be-4afe-be7b-29853c6116d0\" (UID: \"e9ea508f-97be-4afe-be7b-29853c6116d0\") "
Jul 06 02:49:46.758724 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.758702    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9ea508f-97be-4afe-be7b-29853c6116d0" (UID: "e9ea508f-97be-4afe-be7b-29853c6116d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:49:46.759957 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.759918    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp" (OuterVolumeSpecName: "kube-api-access-f8bkp") pod "e9ea508f-97be-4afe-be7b-29853c6116d0" (UID: "e9ea508f-97be-4afe-be7b-29853c6116d0"). InnerVolumeSpecName "kube-api-access-f8bkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:46.760032 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.759972    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h" (OuterVolumeSpecName: "kube-api-access-ppq5h") pod "3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" (UID: "3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8"). InnerVolumeSpecName "kube-api-access-ppq5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:49:46.788649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.788620    2557 generic.go:356] "Generic (PLEG): container finished" podID="e9ea508f-97be-4afe-be7b-29853c6116d0" containerID="c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1" exitCode=0
Jul 06 02:49:46.788742 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.788662    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.788742 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.788713    2557 scope.go:117] "RemoveContainer" containerID="c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1"
Jul 06 02:49:46.790109 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.790085    2557 generic.go:356] "Generic (PLEG): container finished" podID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" containerID="42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253" exitCode=0
Jul 06 02:49:46.790211 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.790124    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.791052 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.791026    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.793169 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.793143    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.794939 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.794914    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.796574 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.796551    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.798209 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.798189    2557 scope.go:117] "RemoveContainer" containerID="c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1"
Jul 06 02:49:46.798588 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.798564    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1\": container with ID starting with c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1 not found: ID does not exist" containerID="c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1"
Jul 06 02:49:46.798690 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.798594    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1"} err="failed to get container status \"c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1\": rpc error: code = NotFound desc = could not find container \"c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1\": container with ID starting with c31665f57215003b2ad23182410153b4a4978d7386033ea974d3aabaa5dc0ff1 not found: ID does not exist"
Jul 06 02:49:46.798690 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.798610    2557 scope.go:117] "RemoveContainer" containerID="42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253"
Jul 06 02:49:46.801379 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.801357    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.803169 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.803151    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:46.803434 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.803410    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.805314 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.805292    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:46.806322 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.806308    2557 scope.go:117] "RemoveContainer" containerID="42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253"
Jul 06 02:49:46.806613 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.806592    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253\": container with ID starting with 42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253 not found: ID does not exist" containerID="42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253"
Jul 06 02:49:46.806656 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.806620    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253"} err="failed to get container status \"42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253\": rpc error: code = NotFound desc = could not find container \"42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253\": container with ID starting with 42ac7b7be03e7cbb082e26a518f7a071c45ca9df30e28d2671168f8158535253 not found: ID does not exist"
Jul 06 02:49:46.807145 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:46.807123    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:46.810372 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.810357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:46.859855 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.859762    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppq5h\" (UniqueName: \"kubernetes.io/projected/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8-kube-api-access-ppq5h\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:49:46.859855 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.859810    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8bkp\" (UniqueName: \"kubernetes.io/projected/e9ea508f-97be-4afe-be7b-29853c6116d0-kube-api-access-f8bkp\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:49:46.859855 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.859827    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9ea508f-97be-4afe-be7b-29853c6116d0-extensions-socket-volume\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:49:46.946748 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.946715    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:49:46.950209 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:49:46.950172    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0d9647_35a6_4d5b_9380_e99cf7bf09af.slice/crio-80ea1ff6809730fd1dbe0d6608bafa2207d3dea3c8222bbab1cc33bc59ab0061 WatchSource:0}: Error finding container 80ea1ff6809730fd1dbe0d6608bafa2207d3dea3c8222bbab1cc33bc59ab0061: Status 404 returned error can't find the container with id 80ea1ff6809730fd1dbe0d6608bafa2207d3dea3c8222bbab1cc33bc59ab0061
Jul 06 02:49:46.965188 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:46.965170    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"]
Jul 06 02:49:46.969107 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:49:46.969081    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c5fc1f_4930_47d0_b184_5f9421367af2.slice/crio-1bf6f2b5d300e3c6565006a66ca38ff366b920a1f701c376001283e9e153b617 WatchSource:0}: Error finding container 1bf6f2b5d300e3c6565006a66ca38ff366b920a1f701c376001283e9e153b617: Status 404 returned error can't find the container with id 1bf6f2b5d300e3c6565006a66ca38ff366b920a1f701c376001283e9e153b617
Jul 06 02:49:47.798181 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.798143    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd" event={"ID":"74c5fc1f-4930-47d0-b184-5f9421367af2","Type":"ContainerStarted","Data":"17a8351426f98cae5954f66075aa89650c3636ffa45958c529e2fefdda63f6d6"}
Jul 06 02:49:47.798669 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.798231    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd" event={"ID":"74c5fc1f-4930-47d0-b184-5f9421367af2","Type":"ContainerStarted","Data":"1bf6f2b5d300e3c6565006a66ca38ff366b920a1f701c376001283e9e153b617"}
Jul 06 02:49:47.798669 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.798260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:47.800634 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.800605    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" event={"ID":"6b0d9647-35a6-4d5b-9380-e99cf7bf09af","Type":"ContainerStarted","Data":"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"}
Jul 06 02:49:47.800738 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.800646    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" event={"ID":"6b0d9647-35a6-4d5b-9380-e99cf7bf09af","Type":"ContainerStarted","Data":"80ea1ff6809730fd1dbe0d6608bafa2207d3dea3c8222bbab1cc33bc59ab0061"}
Jul 06 02:49:47.800738 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.800693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:49:47.817599 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.817554    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd" podStartSLOduration=1.817540599 podStartE2EDuration="1.817540599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:47.816885738 +0000 UTC m=+622.168088059" watchObservedRunningTime="2026-07-06 02:49:47.817540599 +0000 UTC m=+622.168742894"
Jul 06 02:49:47.818865 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:47.818838    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:47.820642 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:47.820616    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:47.822564 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:47.822541    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mhwvj\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhwvj"
Jul 06 02:49:47.824342 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:49:47.824316    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jlz84\" is forbidden: User \"system:node:ip-10-0-139-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-33.ec2.internal' and this object" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jlz84"
Jul 06 02:49:47.845816 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:47.845775    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" podStartSLOduration=1.8457490920000001 podStartE2EDuration="1.845749092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:49:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:49:47.845066811 +0000 UTC m=+622.196269126" watchObservedRunningTime="2026-07-06 02:49:47.845749092 +0000 UTC m=+622.196951387"
Jul 06 02:49:48.231060 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:48.231021    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8" path="/var/lib/kubelet/pods/3720b8bc-7b19-4bc4-9b9d-16a5aeadf8e8/volumes"
Jul 06 02:49:48.231371 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:48.231358    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ea508f-97be-4afe-be7b-29853c6116d0" path="/var/lib/kubelet/pods/e9ea508f-97be-4afe-be7b-29853c6116d0/volumes"
Jul 06 02:49:58.807910 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:58.807869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-88rnd"
Jul 06 02:49:58.808344 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:49:58.807946    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:50:02.725018 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:02.724983    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:50:02.725410 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:02.725165    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" podUID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" containerName="manager" containerID="cri-o://dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008" gracePeriod=10
Jul 06 02:50:03.871937 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.871914    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:50:03.879745 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.879717    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" containerID="dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008" exitCode=0
Jul 06 02:50:03.879907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.879765    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"
Jul 06 02:50:03.879907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.879803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" event={"ID":"6b0d9647-35a6-4d5b-9380-e99cf7bf09af","Type":"ContainerDied","Data":"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"}
Jul 06 02:50:03.879907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.879855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4" event={"ID":"6b0d9647-35a6-4d5b-9380-e99cf7bf09af","Type":"ContainerDied","Data":"80ea1ff6809730fd1dbe0d6608bafa2207d3dea3c8222bbab1cc33bc59ab0061"}
Jul 06 02:50:03.879907 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.879875    2557 scope.go:117] "RemoveContainer" containerID="dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"
Jul 06 02:50:03.888406 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.888391    2557 scope.go:117] "RemoveContainer" containerID="dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"
Jul 06 02:50:03.888678 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:50:03.888660    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008\": container with ID starting with dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008 not found: ID does not exist" containerID="dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"
Jul 06 02:50:03.888732 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.888687    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008"} err="failed to get container status \"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008\": rpc error: code = NotFound desc = could not find container \"dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008\": container with ID starting with dfe52b368ab751d5d09937bcd91421656341806f2eb2a59a25b0e613fb124008 not found: ID does not exist"
Jul 06 02:50:03.900613 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.900589    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume\") pod \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") "
Jul 06 02:50:03.900700 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.900675    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gq7g\" (UniqueName: \"kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g\") pod \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\" (UID: \"6b0d9647-35a6-4d5b-9380-e99cf7bf09af\") "
Jul 06 02:50:03.900970 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.900931    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b0d9647-35a6-4d5b-9380-e99cf7bf09af" (UID: "6b0d9647-35a6-4d5b-9380-e99cf7bf09af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 02:50:03.902835 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:03.902781    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g" (OuterVolumeSpecName: "kube-api-access-4gq7g") pod "6b0d9647-35a6-4d5b-9380-e99cf7bf09af" (UID: "6b0d9647-35a6-4d5b-9380-e99cf7bf09af"). InnerVolumeSpecName "kube-api-access-4gq7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:04.001618 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:04.001593    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gq7g\" (UniqueName: \"kubernetes.io/projected/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-kube-api-access-4gq7g\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:50:04.001618 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:04.001617    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0d9647-35a6-4d5b-9380-e99cf7bf09af-extensions-socket-volume\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:50:04.203481 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:04.203451    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:50:04.207341 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:04.207321    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cj9m4"]
Jul 06 02:50:04.231014 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:04.230992    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" path="/var/lib/kubelet/pods/6b0d9647-35a6-4d5b-9380-e99cf7bf09af/volumes"
Jul 06 02:50:19.050378 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.050339    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"]
Jul 06 02:50:19.050922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.050903    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" containerName="manager"
Jul 06 02:50:19.050986 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.050925    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" containerName="manager"
Jul 06 02:50:19.051041 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.051011    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b0d9647-35a6-4d5b-9380-e99cf7bf09af" containerName="manager"
Jul 06 02:50:19.054282 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.054263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.056557 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.056537    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q7xcs\""
Jul 06 02:50:19.064077 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.064053    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"]
Jul 06 02:50:19.135723 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a09d33-18f7-4149-b4d2-42934c1a53b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.135920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.135920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.135920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.135920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.136091 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.136091 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.135989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rlqx\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-kube-api-access-9rlqx\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.136091 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.136021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.136091 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.136047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237189 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237153    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237189 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237437 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237437 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237437 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rlqx\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-kube-api-access-9rlqx\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237651 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a09d33-18f7-4149-b4d2-42934c1a53b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237858 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237683    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237858 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237802    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.237973 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.237942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.238024 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.238001    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.238387 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.238364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57a09d33-18f7-4149-b4d2-42934c1a53b1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.239587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.239564    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.239824 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.239807    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.247098 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.247074    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.247315 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.247297    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rlqx\" (UniqueName: \"kubernetes.io/projected/57a09d33-18f7-4149-b4d2-42934c1a53b1-kube-api-access-9rlqx\") pod \"maas-default-gateway-openshift-default-56654dcf7-rzdlw\" (UID: \"57a09d33-18f7-4149-b4d2-42934c1a53b1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.367491 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.367394    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:19.501088 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.501058    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"]
Jul 06 02:50:19.503289 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:50:19.503267    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a09d33_18f7_4149_b4d2_42934c1a53b1.slice/crio-cfe2d6550c3797e63d25fcbde7c31ec746f72665a76e4857135b453e56154826 WatchSource:0}: Error finding container cfe2d6550c3797e63d25fcbde7c31ec746f72665a76e4857135b453e56154826: Status 404 returned error can't find the container with id cfe2d6550c3797e63d25fcbde7c31ec746f72665a76e4857135b453e56154826
Jul 06 02:50:19.505844 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.505815    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:50:19.505952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.505877    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:50:19.505952 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.505902    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:50:19.959136 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.959098    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" event={"ID":"57a09d33-18f7-4149-b4d2-42934c1a53b1","Type":"ContainerStarted","Data":"91894417959f5f09e5d75d776fc3ad74bc19e035e6774f42a2b5665680a2ece3"}
Jul 06 02:50:19.959354 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.959155    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" event={"ID":"57a09d33-18f7-4149-b4d2-42934c1a53b1","Type":"ContainerStarted","Data":"cfe2d6550c3797e63d25fcbde7c31ec746f72665a76e4857135b453e56154826"}
Jul 06 02:50:19.978212 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:19.978166    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" podStartSLOduration=0.978153339 podStartE2EDuration="978.153339ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:19.976210424 +0000 UTC m=+654.327412749" watchObservedRunningTime="2026-07-06 02:50:19.978153339 +0000 UTC m=+654.329355635"
Jul 06 02:50:20.367974 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:20.367894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:20.372294 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:20.372272    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:20.964380 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:20.964341    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:20.965143 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:20.965124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:50:21.070784 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.070757    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:21.073975 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.073960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.076100 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.076077    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fszpk\""
Jul 06 02:50:21.076215 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.076112    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 02:50:21.081982 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.081963    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:21.155574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.155538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pc7\" (UniqueName: \"kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.155727 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.155625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.165280 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.165247    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:21.257179 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.257093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pc7\" (UniqueName: \"kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.257179 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.257156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.257832 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.257813    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.265556 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.265534    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pc7\" (UniqueName: \"kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7\") pod \"limitador-limitador-64c94fd64f-sshwh\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.386279 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.386248    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:21.515893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.515868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:21.518324 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:50:21.518298    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8e75f4_1693_4635_914c_f3dd90aaa7fc.slice/crio-eb554f21c3ed56aea9fee8e8372bc6dd4356d2e0cc85e706ee76785d963569eb WatchSource:0}: Error finding container eb554f21c3ed56aea9fee8e8372bc6dd4356d2e0cc85e706ee76785d963569eb: Status 404 returned error can't find the container with id eb554f21c3ed56aea9fee8e8372bc6dd4356d2e0cc85e706ee76785d963569eb
Jul 06 02:50:21.969752 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:21.969712    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" event={"ID":"cc8e75f4-1693-4635-914c-f3dd90aaa7fc","Type":"ContainerStarted","Data":"eb554f21c3ed56aea9fee8e8372bc6dd4356d2e0cc85e706ee76785d963569eb"}
Jul 06 02:50:24.987922 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:24.987871    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" event={"ID":"cc8e75f4-1693-4635-914c-f3dd90aaa7fc","Type":"ContainerStarted","Data":"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"}
Jul 06 02:50:24.988300 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:24.987968    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:25.003090 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:25.003046    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" podStartSLOduration=1.237437301 podStartE2EDuration="4.003030041s" totalImagesPullingTime="2.76559274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:25.00235359 +0000 UTC m=+659.353555903" watchObservedRunningTime="2026-07-06 02:50:25.003030041 +0000 UTC m=+659.354232340"
Jul 06 02:50:35.993433 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:35.993402    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:36.891423 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:36.891384    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:36.891704 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:36.891669    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" podUID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" containerName="limitador" containerID="cri-o://5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a" gracePeriod=30
Jul 06 02:50:37.450600 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.450537    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:37.606938 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.606904    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4pc7\" (UniqueName: \"kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7\") pod \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") "
Jul 06 02:50:37.607110 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.606969    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file\") pod \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\" (UID: \"cc8e75f4-1693-4635-914c-f3dd90aaa7fc\") "
Jul 06 02:50:37.607313 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.607292    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file" (OuterVolumeSpecName: "config-file") pod "cc8e75f4-1693-4635-914c-f3dd90aaa7fc" (UID: "cc8e75f4-1693-4635-914c-f3dd90aaa7fc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 02:50:37.609000 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.608979    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7" (OuterVolumeSpecName: "kube-api-access-r4pc7") pod "cc8e75f4-1693-4635-914c-f3dd90aaa7fc" (UID: "cc8e75f4-1693-4635-914c-f3dd90aaa7fc"). InnerVolumeSpecName "kube-api-access-r4pc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:50:37.708049 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.707977    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pc7\" (UniqueName: \"kubernetes.io/projected/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-kube-api-access-r4pc7\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:50:37.708049 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:37.708005    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cc8e75f4-1693-4635-914c-f3dd90aaa7fc-config-file\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:50:38.051463 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.051387    2557 generic.go:356] "Generic (PLEG): container finished" podID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" containerID="5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a" exitCode=0
Jul 06 02:50:38.051463 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.051433    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh"
Jul 06 02:50:38.051654 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.051486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" event={"ID":"cc8e75f4-1693-4635-914c-f3dd90aaa7fc","Type":"ContainerDied","Data":"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"}
Jul 06 02:50:38.051654 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.051542    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-sshwh" event={"ID":"cc8e75f4-1693-4635-914c-f3dd90aaa7fc","Type":"ContainerDied","Data":"eb554f21c3ed56aea9fee8e8372bc6dd4356d2e0cc85e706ee76785d963569eb"}
Jul 06 02:50:38.051654 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.051571    2557 scope.go:117] "RemoveContainer" containerID="5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"
Jul 06 02:50:38.060878 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.060857    2557 scope.go:117] "RemoveContainer" containerID="5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"
Jul 06 02:50:38.061131 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:50:38.061110    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a\": container with ID starting with 5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a not found: ID does not exist" containerID="5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"
Jul 06 02:50:38.061175 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.061140    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a"} err="failed to get container status \"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a\": rpc error: code = NotFound desc = could not find container \"5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a\": container with ID starting with 5d819432036701f192a25c191de40baa6eb9a219ed1ea135ac07144d92132d8a not found: ID does not exist"
Jul 06 02:50:38.073030 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.072941    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:38.074709 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.074685    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-sshwh"]
Jul 06 02:50:38.230288 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:38.230255    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" path="/var/lib/kubelet/pods/cc8e75f4-1693-4635-914c-f3dd90aaa7fc/volumes"
Jul 06 02:50:42.535913 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.535880    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqrp"]
Jul 06 02:50:42.536511 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.536492    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" containerName="limitador"
Jul 06 02:50:42.536574 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.536514    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" containerName="limitador"
Jul 06 02:50:42.536649 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.536638    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8e75f4-1693-4635-914c-f3dd90aaa7fc" containerName="limitador"
Jul 06 02:50:42.541447 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.541430    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.543883 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.543859    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x9222\""
Jul 06 02:50:42.544005 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.543859    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 02:50:42.544980 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.544955    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqrp"]
Jul 06 02:50:42.547803 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.547779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fk6\" (UniqueName: \"kubernetes.io/projected/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-kube-api-access-v9fk6\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.547920 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.547840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-data\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.648309 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.648283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fk6\" (UniqueName: \"kubernetes.io/projected/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-kube-api-access-v9fk6\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.648440 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.648328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-data\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.648683 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.648663    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-data\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.656848 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.656818    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fk6\" (UniqueName: \"kubernetes.io/projected/9921f7eb-b6dd-4300-bf25-ba7f289d1dd0-kube-api-access-v9fk6\") pod \"postgres-69fb4594cf-tjqrp\" (UID: \"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0\") " pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.854126 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.854050    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:42.990309 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:42.990285    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tjqrp"]
Jul 06 02:50:42.992119 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:50:42.992090    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9921f7eb_b6dd_4300_bf25_ba7f289d1dd0.slice/crio-29b2b6c0ff4bd1a6b429bb6be51020ea8d55edd77e3849c226484d2e75ab4a05 WatchSource:0}: Error finding container 29b2b6c0ff4bd1a6b429bb6be51020ea8d55edd77e3849c226484d2e75ab4a05: Status 404 returned error can't find the container with id 29b2b6c0ff4bd1a6b429bb6be51020ea8d55edd77e3849c226484d2e75ab4a05
Jul 06 02:50:43.082413 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:43.082385    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tjqrp" event={"ID":"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0","Type":"ContainerStarted","Data":"29b2b6c0ff4bd1a6b429bb6be51020ea8d55edd77e3849c226484d2e75ab4a05"}
Jul 06 02:50:48.110712 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:48.110674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tjqrp" event={"ID":"9921f7eb-b6dd-4300-bf25-ba7f289d1dd0","Type":"ContainerStarted","Data":"b5baa588c461c6c383011cf4453d7644874624cf3d1aaec9f9410e1098a7aa8f"}
Jul 06 02:50:48.111111 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:48.110770    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:50:48.126313 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:48.126260    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-tjqrp" podStartSLOduration=1.112346103 podStartE2EDuration="6.126242721s" totalImagesPullingTime="5.013896618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:50:48.126005489 +0000 UTC m=+682.477207810" watchObservedRunningTime="2026-07-06 02:50:48.126242721 +0000 UTC m=+682.477445019"
Jul 06 02:50:54.148365 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:50:54.148337    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-tjqrp"
Jul 06 02:51:01.464081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.464042    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:01.481030 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.480991    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:01.481208 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.481132    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.483736 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.483711    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 02:51:01.483867 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.483751    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 02:51:01.483867 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.483756    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-smdnd\""
Jul 06 02:51:01.618136 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.618105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxpt\" (UniqueName: \"kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.618303 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.618163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.641123 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.641098    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:51:01.644695 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.644679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.652803 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.652780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:51:01.719631 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.719565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.719631 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.719595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knqxp\" (UniqueName: \"kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.719847 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.719641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxpt\" (UniqueName: \"kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.719847 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.719682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.721916 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.721898    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.726663 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.726638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxpt\" (UniqueName: \"kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt\") pod \"maas-controller-95c6bb8cc-lp2f2\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") " pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.791761 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.791735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:01.820915 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.820890    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.821031 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.820925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knqxp\" (UniqueName: \"kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.823015 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.822994    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.828704 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.828675    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knqxp\" (UniqueName: \"kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp\") pod \"maas-controller-7d64479c74-kzl7m\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") " pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:01.921754 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.921721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:01.923485 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:51:01.923442    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d954c8_d329_4367_b399_877dafd41e52.slice/crio-051486d7b099e180d716eecf34d0edcb240ddc02cdc471739c7bfb0578c80d91 WatchSource:0}: Error finding container 051486d7b099e180d716eecf34d0edcb240ddc02cdc471739c7bfb0578c80d91: Status 404 returned error can't find the container with id 051486d7b099e180d716eecf34d0edcb240ddc02cdc471739c7bfb0578c80d91
Jul 06 02:51:01.956453 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:01.956428    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:02.084425 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:02.084393    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:51:02.087534 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:51:02.087507    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed18726_7e0a_4cf4_bccf_7dbc1cf02e75.slice/crio-4032431b0af1ec864e2d6a4678e818cc706125dcd4c938dce371beb6ef4ae2ba WatchSource:0}: Error finding container 4032431b0af1ec864e2d6a4678e818cc706125dcd4c938dce371beb6ef4ae2ba: Status 404 returned error can't find the container with id 4032431b0af1ec864e2d6a4678e818cc706125dcd4c938dce371beb6ef4ae2ba
Jul 06 02:51:02.188495 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:02.188447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" event={"ID":"e7d954c8-d329-4367-b399-877dafd41e52","Type":"ContainerStarted","Data":"051486d7b099e180d716eecf34d0edcb240ddc02cdc471739c7bfb0578c80d91"}
Jul 06 02:51:02.189657 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:02.189635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-kzl7m" event={"ID":"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75","Type":"ContainerStarted","Data":"4032431b0af1ec864e2d6a4678e818cc706125dcd4c938dce371beb6ef4ae2ba"}
Jul 06 02:51:05.212797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.212764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-kzl7m" event={"ID":"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75","Type":"ContainerStarted","Data":"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"}
Jul 06 02:51:05.213210 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.212832    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:05.214346 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.214321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" event={"ID":"e7d954c8-d329-4367-b399-877dafd41e52","Type":"ContainerStarted","Data":"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"}
Jul 06 02:51:05.214504 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.214375    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:05.240591 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.240542    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d64479c74-kzl7m" podStartSLOduration=1.64956407 podStartE2EDuration="4.240527931s" totalImagesPullingTime="2.590963861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:05.238778422 +0000 UTC m=+699.589980730" watchObservedRunningTime="2026-07-06 02:51:05.240527931 +0000 UTC m=+699.591730231"
Jul 06 02:51:05.259671 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:05.259634    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" podStartSLOduration=1.497891609 podStartE2EDuration="4.259621375s" totalImagesPullingTime="2.761729766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:05.257745132 +0000 UTC m=+699.608947441" watchObservedRunningTime="2026-07-06 02:51:05.259621375 +0000 UTC m=+699.610823671"
Jul 06 02:51:16.233236 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.233208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:16.233743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.233267    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:51:16.290596 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.290559    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:16.290807 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.290778    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" podUID="e7d954c8-d329-4367-b399-877dafd41e52" containerName="manager" containerID="cri-o://324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc" gracePeriod=30
Jul 06 02:51:16.552386 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.552362    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:16.662017 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.661991    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccxpt\" (UniqueName: \"kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt\") pod \"e7d954c8-d329-4367-b399-877dafd41e52\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") "
Jul 06 02:51:16.662200 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.662096    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert\") pod \"e7d954c8-d329-4367-b399-877dafd41e52\" (UID: \"e7d954c8-d329-4367-b399-877dafd41e52\") "
Jul 06 02:51:16.664077 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.664050    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e7d954c8-d329-4367-b399-877dafd41e52" (UID: "e7d954c8-d329-4367-b399-877dafd41e52"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:51:16.664192 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.664124    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt" (OuterVolumeSpecName: "kube-api-access-ccxpt") pod "e7d954c8-d329-4367-b399-877dafd41e52" (UID: "e7d954c8-d329-4367-b399-877dafd41e52"). InnerVolumeSpecName "kube-api-access-ccxpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:51:16.763273 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.763231    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7d954c8-d329-4367-b399-877dafd41e52-webhook-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:51:16.763273 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:16.763270    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccxpt\" (UniqueName: \"kubernetes.io/projected/e7d954c8-d329-4367-b399-877dafd41e52-kube-api-access-ccxpt\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:51:17.273743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.273708    2557 generic.go:356] "Generic (PLEG): container finished" podID="e7d954c8-d329-4367-b399-877dafd41e52" containerID="324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc" exitCode=0
Jul 06 02:51:17.274187 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.273753    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2"
Jul 06 02:51:17.274187 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.273765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" event={"ID":"e7d954c8-d329-4367-b399-877dafd41e52","Type":"ContainerDied","Data":"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"}
Jul 06 02:51:17.274187 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.273806    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-95c6bb8cc-lp2f2" event={"ID":"e7d954c8-d329-4367-b399-877dafd41e52","Type":"ContainerDied","Data":"051486d7b099e180d716eecf34d0edcb240ddc02cdc471739c7bfb0578c80d91"}
Jul 06 02:51:17.274187 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.273827    2557 scope.go:117] "RemoveContainer" containerID="324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"
Jul 06 02:51:17.283972 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.283952    2557 scope.go:117] "RemoveContainer" containerID="324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"
Jul 06 02:51:17.284259 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:51:17.284238    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc\": container with ID starting with 324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc not found: ID does not exist" containerID="324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"
Jul 06 02:51:17.284334 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.284271    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc"} err="failed to get container status \"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc\": rpc error: code = NotFound desc = could not find container \"324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc\": container with ID starting with 324d5f91c95dfdf0edb1ee4ee15d3824972eb1e46eb1f6995ae50a22f744f5bc not found: ID does not exist"
Jul 06 02:51:17.295858 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.295828    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:17.299349 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:17.299324    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-95c6bb8cc-lp2f2"]
Jul 06 02:51:18.230027 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:18.229951    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d954c8-d329-4367-b399-877dafd41e52" path="/var/lib/kubelet/pods/e7d954c8-d329-4367-b399-877dafd41e52/volumes"
Jul 06 02:51:38.093320 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.093286    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5f9c958f9-j2wdm"]
Jul 06 02:51:38.093714 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.093686    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d954c8-d329-4367-b399-877dafd41e52" containerName="manager"
Jul 06 02:51:38.093714 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.093700    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d954c8-d329-4367-b399-877dafd41e52" containerName="manager"
Jul 06 02:51:38.093795 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.093779    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d954c8-d329-4367-b399-877dafd41e52" containerName="manager"
Jul 06 02:51:38.101449 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.101421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.104685 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.104656    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 02:51:38.105797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.105778    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mg4mh\""
Jul 06 02:51:38.107184 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.107161    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f9c958f9-j2wdm"]
Jul 06 02:51:38.163355 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.163326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3245278-ed57-4a81-a52d-020a1cda37af-openshift-service-ca\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.163516 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.163373    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgz7\" (UniqueName: \"kubernetes.io/projected/e3245278-ed57-4a81-a52d-020a1cda37af-kube-api-access-gjgz7\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.163602 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.163576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.264820 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.264787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.264988 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.264839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3245278-ed57-4a81-a52d-020a1cda37af-openshift-service-ca\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.264988 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.264876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgz7\" (UniqueName: \"kubernetes.io/projected/e3245278-ed57-4a81-a52d-020a1cda37af-kube-api-access-gjgz7\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.264988 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:51:38.264960    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 02:51:38.265098 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:51:38.265042    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls podName:e3245278-ed57-4a81-a52d-020a1cda37af nodeName:}" failed. No retries permitted until 2026-07-06 02:51:38.765020874 +0000 UTC m=+733.116223150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls") pod "maas-api-5f9c958f9-j2wdm" (UID: "e3245278-ed57-4a81-a52d-020a1cda37af") : secret "maas-api-serving-cert" not found
Jul 06 02:51:38.265487 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.265456    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3245278-ed57-4a81-a52d-020a1cda37af-openshift-service-ca\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.273496 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.273447    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgz7\" (UniqueName: \"kubernetes.io/projected/e3245278-ed57-4a81-a52d-020a1cda37af-kube-api-access-gjgz7\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.565386 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.565354    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qcrx8"]
Jul 06 02:51:38.606080 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.606048    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qcrx8"]
Jul 06 02:51:38.606234 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.606157    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.608384 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.608362    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rjdlp\""
Jul 06 02:51:38.608548 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.608532    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 02:51:38.668005 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.667977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/185ecd0e-545e-4a3b-85d1-b08db725c6c5-kube-api-access-pw4q4\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.668137 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.668028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185ecd0e-545e-4a3b-85d1-b08db725c6c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.769039 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.769002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.769039 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.769035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185ecd0e-545e-4a3b-85d1-b08db725c6c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.769302 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.769156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/185ecd0e-545e-4a3b-85d1-b08db725c6c5-kube-api-access-pw4q4\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.769822 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.769800    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/185ecd0e-545e-4a3b-85d1-b08db725c6c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.771457 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.771439    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3245278-ed57-4a81-a52d-020a1cda37af-maas-api-tls\") pod \"maas-api-5f9c958f9-j2wdm\" (UID: \"e3245278-ed57-4a81-a52d-020a1cda37af\") " pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:38.776676 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.776652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4q4\" (UniqueName: \"kubernetes.io/projected/185ecd0e-545e-4a3b-85d1-b08db725c6c5-kube-api-access-pw4q4\") pod \"payload-pre-processing-7964457696-qcrx8\" (UID: \"185ecd0e-545e-4a3b-85d1-b08db725c6c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:38.918008 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:38.917931    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:39.014029 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:39.013948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:39.051431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:39.051399    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qcrx8"]
Jul 06 02:51:39.055145 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:51:39.055100    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185ecd0e_545e_4a3b_85d1_b08db725c6c5.slice/crio-ed56960f55569cc4ec041a5ae583d74606300c1165e1b2324caa81bd5c41c3e6 WatchSource:0}: Error finding container ed56960f55569cc4ec041a5ae583d74606300c1165e1b2324caa81bd5c41c3e6: Status 404 returned error can't find the container with id ed56960f55569cc4ec041a5ae583d74606300c1165e1b2324caa81bd5c41c3e6
Jul 06 02:51:39.197131 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:39.197105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f9c958f9-j2wdm"]
Jul 06 02:51:39.199509 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:51:39.199482    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3245278_ed57_4a81_a52d_020a1cda37af.slice/crio-2581fe84b7ea8c268613216b049b313d32224f1d1545d5335f99782bbef4e8f1 WatchSource:0}: Error finding container 2581fe84b7ea8c268613216b049b313d32224f1d1545d5335f99782bbef4e8f1: Status 404 returned error can't find the container with id 2581fe84b7ea8c268613216b049b313d32224f1d1545d5335f99782bbef4e8f1
Jul 06 02:51:39.383289 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:39.383251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8" event={"ID":"185ecd0e-545e-4a3b-85d1-b08db725c6c5","Type":"ContainerStarted","Data":"ed56960f55569cc4ec041a5ae583d74606300c1165e1b2324caa81bd5c41c3e6"}
Jul 06 02:51:39.384510 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:39.384457    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f9c958f9-j2wdm" event={"ID":"e3245278-ed57-4a81-a52d-020a1cda37af","Type":"ContainerStarted","Data":"2581fe84b7ea8c268613216b049b313d32224f1d1545d5335f99782bbef4e8f1"}
Jul 06 02:51:41.397701 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.397670    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f9c958f9-j2wdm" event={"ID":"e3245278-ed57-4a81-a52d-020a1cda37af","Type":"ContainerStarted","Data":"66d382f7acb13f53a203f3abcaac2378acf6344c1eefbb8781fed4079eece33f"}
Jul 06 02:51:41.398151 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.397741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:41.399268 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.399244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8" event={"ID":"185ecd0e-545e-4a3b-85d1-b08db725c6c5","Type":"ContainerStarted","Data":"431253e8fbf69ca4d4420cd195e191239833ccbe15117501f3670bdfd6edd232"}
Jul 06 02:51:41.399378 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.399297    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:51:41.414145 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.414106    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5f9c958f9-j2wdm" podStartSLOduration=1.6850739510000001 podStartE2EDuration="3.414092336s" totalImagesPullingTime="1.729018385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:41.412439171 +0000 UTC m=+735.763641468" watchObservedRunningTime="2026-07-06 02:51:41.414092336 +0000 UTC m=+735.765294632"
Jul 06 02:51:41.426751 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:41.426712    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8" podStartSLOduration=1.557490563 podStartE2EDuration="3.426698749s" totalImagesPullingTime="1.869208186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:41.426124702 +0000 UTC m=+735.777327038" watchObservedRunningTime="2026-07-06 02:51:41.426698749 +0000 UTC m=+735.777901046"
Jul 06 02:51:46.428538 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.428504    2557 generic.go:356] "Generic (PLEG): container finished" podID="57a09d33-18f7-4149-b4d2-42934c1a53b1" containerID="91894417959f5f09e5d75d776fc3ad74bc19e035e6774f42a2b5665680a2ece3" exitCode=0
Jul 06 02:51:46.429055 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.428562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" event={"ID":"57a09d33-18f7-4149-b4d2-42934c1a53b1","Type":"ContainerDied","Data":"91894417959f5f09e5d75d776fc3ad74bc19e035e6774f42a2b5665680a2ece3"}
Jul 06 02:51:46.429055 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.429045    2557 scope.go:117] "RemoveContainer" containerID="91894417959f5f09e5d75d776fc3ad74bc19e035e6774f42a2b5665680a2ece3"
Jul 06 02:51:46.430023 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.429996    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:51:46.430123 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.430063    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:51:46.430123 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:46.430097    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 02:51:47.410584 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:47.410557    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5f9c958f9-j2wdm"
Jul 06 02:51:47.436988 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:47.436948    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" event={"ID":"57a09d33-18f7-4149-b4d2-42934c1a53b1","Type":"ContainerStarted","Data":"ec624168cd47e76333675b40acef78cb3a85475bc91015b0473e5ce0aab57df1"}
Jul 06 02:51:48.368550 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:48.368519    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:51:48.369653 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:48.369627    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rzdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 06 02:51:48.369842 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:48.369818    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" podUID="57a09d33-18f7-4149-b4d2-42934c1a53b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 06 02:51:49.367904 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:49.367863    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rzdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 06 02:51:49.368392 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:49.367949    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" podUID="57a09d33-18f7-4149-b4d2-42934c1a53b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 06 02:51:50.368785 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:50.368747    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rzdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 06 02:51:50.369776 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:50.369356    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" podUID="57a09d33-18f7-4149-b4d2-42934c1a53b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 06 02:51:50.964421 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:50.964379    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:51:51.369181 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:51.368673    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rzdlw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 06 02:51:51.369181 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:51.368754    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw" podUID="57a09d33-18f7-4149-b4d2-42934c1a53b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 06 02:51:52.372172 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:52.372144    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:51:52.373034 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:52.373012    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rzdlw"
Jul 06 02:51:52.404654 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:52.404621    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8" podUID="185ecd0e-545e-4a3b-85d1-b08db725c6c5" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.41:9004: connect: connection refused"
Jul 06 02:51:57.352706 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.352671    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"]
Jul 06 02:51:57.356185 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.356164    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.359393 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.359372    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 02:51:57.359540 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.359412    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bdtkj\""
Jul 06 02:51:57.359540 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.359420    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 02:51:57.359540 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.359414    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 02:51:57.366932 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.366905    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"]
Jul 06 02:51:57.552502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552373    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82687ee8-03f5-4445-9b8d-459b338d9acf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.552502 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552429    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.552826 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.552826 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.552826 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5pbw\" (UniqueName: \"kubernetes.io/projected/82687ee8-03f5-4445-9b8d-459b338d9acf-kube-api-access-b5pbw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.552826 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.552747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654251 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654251 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5pbw\" (UniqueName: \"kubernetes.io/projected/82687ee8-03f5-4445-9b8d-459b338d9acf-kube-api-access-b5pbw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654518 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654518 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82687ee8-03f5-4445-9b8d-459b338d9acf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654518 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654518 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654632    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654746    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.654810 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.654754    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.656692 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.656666    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82687ee8-03f5-4445-9b8d-459b338d9acf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.656862 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.656844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82687ee8-03f5-4445-9b8d-459b338d9acf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.662081 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.662059    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5pbw\" (UniqueName: \"kubernetes.io/projected/82687ee8-03f5-4445-9b8d-459b338d9acf-kube-api-access-b5pbw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml\" (UID: \"82687ee8-03f5-4445-9b8d-459b338d9acf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.667927 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.667906    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:51:57.800743 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:57.800719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"]
Jul 06 02:51:57.802699 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:51:57.802667    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82687ee8_03f5_4445_9b8d_459b338d9acf.slice/crio-76ae5a1a328778410223fea74689cc31b81a15dcbb9a7f8f1817e4d3644edffb WatchSource:0}: Error finding container 76ae5a1a328778410223fea74689cc31b81a15dcbb9a7f8f1817e4d3644edffb: Status 404 returned error can't find the container with id 76ae5a1a328778410223fea74689cc31b81a15dcbb9a7f8f1817e4d3644edffb
Jul 06 02:51:58.499458 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:58.499411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml" event={"ID":"82687ee8-03f5-4445-9b8d-459b338d9acf","Type":"ContainerStarted","Data":"76ae5a1a328778410223fea74689cc31b81a15dcbb9a7f8f1817e4d3644edffb"}
Jul 06 02:51:59.506457 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:59.506412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml" event={"ID":"82687ee8-03f5-4445-9b8d-459b338d9acf","Type":"ContainerStarted","Data":"098c2597796c262bdcfd8677a04e830553c95b258b09c8b8b7f48ff5b61cbaac"}
Jul 06 02:51:59.523388 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:51:59.523324    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml" podStartSLOduration=1.320837271 podStartE2EDuration="2.523308829s" totalImagesPullingTime="1.202471558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:51:59.521542787 +0000 UTC m=+753.872745084" watchObservedRunningTime="2026-07-06 02:51:59.523308829 +0000 UTC m=+753.874511173"
Jul 06 02:52:02.404192 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:02.404162    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qcrx8"
Jul 06 02:52:07.669057 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:07.669025    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:52:07.669442 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:07.669080    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:52:07.681431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:07.681407    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:52:08.561431 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:08.561396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml"
Jul 06 02:52:12.258447 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.258411    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"]
Jul 06 02:52:12.263300 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.263280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.265421 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.265400    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 02:52:12.269627 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.269602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"]
Jul 06 02:52:12.388399 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.388536 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.388536 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.388671 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9lpt\" (UniqueName: \"kubernetes.io/projected/7f9e762f-c748-4534-b47b-d08bc23ad468-kube-api-access-j9lpt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.388671 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.388671 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.388592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9e762f-c748-4534-b47b-d08bc23ad468-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489429 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489429 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489431    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9e762f-c748-4534-b47b-d08bc23ad468-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489635 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489635 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489635 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489788 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9lpt\" (UniqueName: \"kubernetes.io/projected/7f9e762f-c748-4534-b47b-d08bc23ad468-kube-api-access-j9lpt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489850 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489834    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489912 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489880    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.489983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.489960    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.491868 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.491837    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f9e762f-c748-4534-b47b-d08bc23ad468-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.491976 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.491935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f9e762f-c748-4534-b47b-d08bc23ad468-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.497570 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.497547    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9lpt\" (UniqueName: \"kubernetes.io/projected/7f9e762f-c748-4534-b47b-d08bc23ad468-kube-api-access-j9lpt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mcrhb\" (UID: \"7f9e762f-c748-4534-b47b-d08bc23ad468\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.574617 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.574559    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:12.702882 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:12.702856    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"]
Jul 06 02:52:12.704702 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:52:12.704675    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e762f_c748_4534_b47b_d08bc23ad468.slice/crio-65b07c145727a9dcbc87c769c3d004e6768398810c58e22fdce3099f841ce13b WatchSource:0}: Error finding container 65b07c145727a9dcbc87c769c3d004e6768398810c58e22fdce3099f841ce13b: Status 404 returned error can't find the container with id 65b07c145727a9dcbc87c769c3d004e6768398810c58e22fdce3099f841ce13b
Jul 06 02:52:13.574583 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:13.574548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb" event={"ID":"7f9e762f-c748-4534-b47b-d08bc23ad468","Type":"ContainerStarted","Data":"7549f1f0dc611d839a9a3b9a8cf2054465d72d72abdcc8878dfc2572ea66017c"}
Jul 06 02:52:13.575019 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:13.574602    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb" event={"ID":"7f9e762f-c748-4534-b47b-d08bc23ad468","Type":"ContainerStarted","Data":"65b07c145727a9dcbc87c769c3d004e6768398810c58e22fdce3099f841ce13b"}
Jul 06 02:52:13.595893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:13.595848    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb" podStartSLOduration=1.425428828 podStartE2EDuration="1.595832089s" totalImagesPullingTime="170.403261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:52:13.594532089 +0000 UTC m=+767.945734404" watchObservedRunningTime="2026-07-06 02:52:13.595832089 +0000 UTC m=+767.947034385"
Jul 06 02:52:22.575587 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:22.575514    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:22.576070 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:22.575607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:22.587886 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:22.587860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:22.629090 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:22.629062    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mcrhb"
Jul 06 02:52:51.459941 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.459861    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"]
Jul 06 02:52:51.463543 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.463516    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.465865 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.465838    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 02:52:51.473801 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.473776    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"]
Jul 06 02:52:51.546192 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c580366-4dbb-4e99-a9cf-246e64848d68-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.546356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.546356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.546356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.546356 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlhx\" (UniqueName: \"kubernetes.io/projected/4c580366-4dbb-4e99-a9cf-246e64848d68-kube-api-access-9dlhx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.546556 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.546362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648001 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.647966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c580366-4dbb-4e99-a9cf-246e64848d68-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648193 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.648032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648193 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.648080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648193 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.648138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648369 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.648197    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlhx\" (UniqueName: \"kubernetes.io/projected/4c580366-4dbb-4e99-a9cf-246e64848d68-kube-api-access-9dlhx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.648369 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.648235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.649403 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.649345    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.649576 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.649522    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.649931 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.649912    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.651794 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.651771    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c580366-4dbb-4e99-a9cf-246e64848d68-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.651903 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.651820    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c580366-4dbb-4e99-a9cf-246e64848d68-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.656266 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.656243    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlhx\" (UniqueName: \"kubernetes.io/projected/4c580366-4dbb-4e99-a9cf-246e64848d68-kube-api-access-9dlhx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-h457c\" (UID: \"4c580366-4dbb-4e99-a9cf-246e64848d68\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.775944 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.775863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:52:51.904529 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.904503    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"]
Jul 06 02:52:51.906593 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:52:51.906567    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c580366_4dbb_4e99_a9cf_246e64848d68.slice/crio-24882e38dec67a7d2fb9cab90bc07c761f5a0e48f1fe7bf91dfd91f8b16f7b3c WatchSource:0}: Error finding container 24882e38dec67a7d2fb9cab90bc07c761f5a0e48f1fe7bf91dfd91f8b16f7b3c: Status 404 returned error can't find the container with id 24882e38dec67a7d2fb9cab90bc07c761f5a0e48f1fe7bf91dfd91f8b16f7b3c
Jul 06 02:52:51.908404 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:51.908382    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 02:52:52.776170 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:52.776131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c" event={"ID":"4c580366-4dbb-4e99-a9cf-246e64848d68","Type":"ContainerStarted","Data":"00a10e79c4f49affd0118a63c4be44e19b55090b74675e7b274b5a7f4f94917d"}
Jul 06 02:52:52.776567 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:52.776196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c" event={"ID":"4c580366-4dbb-4e99-a9cf-246e64848d68","Type":"ContainerStarted","Data":"24882e38dec67a7d2fb9cab90bc07c761f5a0e48f1fe7bf91dfd91f8b16f7b3c"}
Jul 06 02:52:52.792323 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:52:52.792268    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c" podStartSLOduration=1.626327332 podStartE2EDuration="1.792251172s" totalImagesPullingTime="165.92384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:52:52.791509655 +0000 UTC m=+807.142711972" watchObservedRunningTime="2026-07-06 02:52:52.792251172 +0000 UTC m=+807.143453471"
Jul 06 02:53:01.776972 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:53:01.776938    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:53:01.777499 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:53:01.776992    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:53:01.789568 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:53:01.789548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:53:01.830775 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:53:01.830747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-h457c"
Jul 06 02:54:26.169983 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:54:26.169902    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:54:26.172816 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:54:26.172796    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:55:32.278446 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.278406    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:55:32.279009 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.278654    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d64479c74-kzl7m" podUID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" containerName="manager" containerID="cri-o://9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513" gracePeriod=30
Jul 06 02:55:32.528917 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.528851    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:55:32.529450 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.529433    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert\") pod \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") "
Jul 06 02:55:32.529611 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.529593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knqxp\" (UniqueName: \"kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp\") pod \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\" (UID: \"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75\") "
Jul 06 02:55:32.531365 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.531312    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" (UID: "eed18726-7e0a-4cf4-bccf-7dbc1cf02e75"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 02:55:32.531541 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.531464    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp" (OuterVolumeSpecName: "kube-api-access-knqxp") pod "eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" (UID: "eed18726-7e0a-4cf4-bccf-7dbc1cf02e75"). InnerVolumeSpecName "kube-api-access-knqxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 02:55:32.561631 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.561589    2557 generic.go:356] "Generic (PLEG): container finished" podID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" containerID="9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513" exitCode=0
Jul 06 02:55:32.561797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.561641    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-kzl7m"
Jul 06 02:55:32.561797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.561660    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-kzl7m" event={"ID":"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75","Type":"ContainerDied","Data":"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"}
Jul 06 02:55:32.561797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.561726    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-kzl7m" event={"ID":"eed18726-7e0a-4cf4-bccf-7dbc1cf02e75","Type":"ContainerDied","Data":"4032431b0af1ec864e2d6a4678e818cc706125dcd4c938dce371beb6ef4ae2ba"}
Jul 06 02:55:32.561797 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.561753    2557 scope.go:117] "RemoveContainer" containerID="9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"
Jul 06 02:55:32.571893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.571874    2557 scope.go:117] "RemoveContainer" containerID="9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"
Jul 06 02:55:32.572175 ip-10-0-139-33 kubenswrapper[2557]: E0706 02:55:32.572157    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513\": container with ID starting with 9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513 not found: ID does not exist" containerID="9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"
Jul 06 02:55:32.572267 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.572183    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513"} err="failed to get container status \"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513\": rpc error: code = NotFound desc = could not find container \"9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513\": container with ID starting with 9b2bae8e192331f1470caa1f8c9c69d45832858d59e8ce48ebcc06db2980e513 not found: ID does not exist"
Jul 06 02:55:32.587293 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.587258    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:55:32.589655 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.589637    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d64479c74-kzl7m"]
Jul 06 02:55:32.630869 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.630846    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knqxp\" (UniqueName: \"kubernetes.io/projected/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-kube-api-access-knqxp\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:55:32.630869 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:32.630867    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75-webhook-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 02:55:33.335953 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.335917    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d64479c74-ls9k5"]
Jul 06 02:55:33.336360 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.336344    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" containerName="manager"
Jul 06 02:55:33.336403 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.336362    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" containerName="manager"
Jul 06 02:55:33.336445 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.336435    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" containerName="manager"
Jul 06 02:55:33.340724 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.340705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.344072 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.344053    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-smdnd\""
Jul 06 02:55:33.344176 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.344054    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 02:55:33.344176 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.344075    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 02:55:33.348184 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.348160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d64479c74-ls9k5"]
Jul 06 02:55:33.436562 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.436537    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-webhook-cert\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.436683 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.436576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj6bm\" (UniqueName: \"kubernetes.io/projected/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-kube-api-access-zj6bm\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.538089 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.538055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-webhook-cert\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.538241 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.538096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj6bm\" (UniqueName: \"kubernetes.io/projected/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-kube-api-access-zj6bm\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.540284 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.540260    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-webhook-cert\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.545219 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.545194    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj6bm\" (UniqueName: \"kubernetes.io/projected/d497c03b-4fa8-4b71-9bd8-5cef7a61909c-kube-api-access-zj6bm\") pod \"maas-controller-7d64479c74-ls9k5\" (UID: \"d497c03b-4fa8-4b71-9bd8-5cef7a61909c\") " pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.651331 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.651256    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:33.994616 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:33.994592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d64479c74-ls9k5"]
Jul 06 02:55:33.996884 ip-10-0-139-33 kubenswrapper[2557]: W0706 02:55:33.996859    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd497c03b_4fa8_4b71_9bd8_5cef7a61909c.slice/crio-d8102accb43e5df2f25d0fa56f68e9f32003efb374bf518f5d4e22146ee07062 WatchSource:0}: Error finding container d8102accb43e5df2f25d0fa56f68e9f32003efb374bf518f5d4e22146ee07062: Status 404 returned error can't find the container with id d8102accb43e5df2f25d0fa56f68e9f32003efb374bf518f5d4e22146ee07062
Jul 06 02:55:34.233893 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:34.233857    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eed18726-7e0a-4cf4-bccf-7dbc1cf02e75" path="/var/lib/kubelet/pods/eed18726-7e0a-4cf4-bccf-7dbc1cf02e75/volumes"
Jul 06 02:55:34.574755 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:34.574719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-ls9k5" event={"ID":"d497c03b-4fa8-4b71-9bd8-5cef7a61909c","Type":"ContainerStarted","Data":"e4a81bfb9fb751bd59f697d2a806055cccb883185aac99443bc7837491955a78"}
Jul 06 02:55:34.575158 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:34.574783    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d64479c74-ls9k5" event={"ID":"d497c03b-4fa8-4b71-9bd8-5cef7a61909c","Type":"ContainerStarted","Data":"d8102accb43e5df2f25d0fa56f68e9f32003efb374bf518f5d4e22146ee07062"}
Jul 06 02:55:34.575158 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:34.574813    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:55:34.593295 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:34.593249    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d64479c74-ls9k5" podStartSLOduration=1.202912009 podStartE2EDuration="1.593234592s" totalImagesPullingTime="390.322583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 02:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 02:55:34.592118509 +0000 UTC m=+968.943320853" watchObservedRunningTime="2026-07-06 02:55:34.593234592 +0000 UTC m=+968.944436887"
Jul 06 02:55:45.585059 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:55:45.585027    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d64479c74-ls9k5"
Jul 06 02:59:26.203523 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:59:26.203493    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 02:59:26.207177 ip-10-0-139-33 kubenswrapper[2557]: I0706 02:59:26.207156    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:04:26.241902 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:04:26.241802    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:04:26.247504 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:04:26.247463    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:07:33.155565 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.155531    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:33.159234 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.159212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.161705 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.161683    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8d603a52-openshift-default-dockercfg-k46cg\""
Jul 06 03:07:33.177216 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.177189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:33.278075 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278075 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkt94\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278226    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278514 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.278514 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.278359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379465 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379644 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379644 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379644 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379797 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379797 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379797 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkt94\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.379958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.379831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.380064 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.380033    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.380147 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.380116    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.380317 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.380287    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.380418 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.380320    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.380418 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.380350    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.382148 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.382113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.382344 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.382327    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.388022 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.388001    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.388207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.388188    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkt94\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94\") pod \"e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") " pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.470341 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.470315    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:33.610596 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.610534    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:33.617054 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.617016    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:07:33.617157 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.617097    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:07:33.617157 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:33.617141    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:07:34.197535 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.197498    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" event={"ID":"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e","Type":"ContainerStarted","Data":"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"}
Jul 06 03:07:34.197905 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.197558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" event={"ID":"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e","Type":"ContainerStarted","Data":"78b101d8d5fac08075bef022ca8bd8338a7f2cc3b9682c471143ee4d615b5405"}
Jul 06 03:07:34.220100 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.220053    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" podStartSLOduration=1.220038198 podStartE2EDuration="1.220038198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:07:34.218579879 +0000 UTC m=+1688.569782190" watchObservedRunningTime="2026-07-06 03:07:34.220038198 +0000 UTC m=+1688.571240494"
Jul 06 03:07:34.471300 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.471195    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:34.497976 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.497943    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:34.606883 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.606855    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:34.610358 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.610341    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.613116 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.613082    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-8d603a52-serving-cert\""
Jul 06 03:07:34.622598 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.622395    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:34.693016 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.692991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.693163 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.693032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdmhz\" (UniqueName: \"kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.693163 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.693061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.794323 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.794245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdmhz\" (UniqueName: \"kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.794323 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.794289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.794526 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.794360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.794995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.794977    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.796989 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.796959    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.802539 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.802517    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdmhz\" (UniqueName: \"kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz\") pod \"maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") " pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:34.924713 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:34.924684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:35.064512 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:35.063633    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:35.066547 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:07:35.066514    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800ca32c_1bc1_4912_ade9_868855facacc.slice/crio-b60bc670d6f94dc77e32eac8813c54b18824bee269f27d0f732fd9f6f394a97b WatchSource:0}: Error finding container b60bc670d6f94dc77e32eac8813c54b18824bee269f27d0f732fd9f6f394a97b: Status 404 returned error can't find the container with id b60bc670d6f94dc77e32eac8813c54b18824bee269f27d0f732fd9f6f394a97b
Jul 06 03:07:35.068152 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:35.068136    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 03:07:35.203884 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:35.203844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" event={"ID":"800ca32c-1bc1-4912-ade9-868855facacc","Type":"ContainerStarted","Data":"b60bc670d6f94dc77e32eac8813c54b18824bee269f27d0f732fd9f6f394a97b"}
Jul 06 03:07:35.204254 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:35.204042    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:35.204943 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:35.204925    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:36.210057 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:36.210021    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" event={"ID":"800ca32c-1bc1-4912-ade9-868855facacc","Type":"ContainerStarted","Data":"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"}
Jul 06 03:07:36.229389 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:36.229332    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" podStartSLOduration=1.7323373069999999 podStartE2EDuration="2.229312223s" totalImagesPullingTime="496.974916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:07:36.226960432 +0000 UTC m=+1690.578162728" watchObservedRunningTime="2026-07-06 03:07:36.229312223 +0000 UTC m=+1690.580514522"
Jul 06 03:07:37.215237 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:37.215194    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:39.650706 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:39.650668    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:39.651171 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:39.650854    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" podUID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" containerName="istio-proxy" containerID="cri-o://2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c" gracePeriod=30
Jul 06 03:07:39.868461 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:39.868422    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:39.869038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:39.868968    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" podUID="800ca32c-1bc1-4912-ade9-868855facacc" containerName="maas-api" containerID="cri-o://9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a" gracePeriod=30
Jul 06 03:07:40.133365 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.133338    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:40.232618 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.232588    2557 generic.go:356] "Generic (PLEG): container finished" podID="800ca32c-1bc1-4912-ade9-868855facacc" containerID="9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a" exitCode=0
Jul 06 03:07:40.232801 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.232691    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"
Jul 06 03:07:40.233052 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.233034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" event={"ID":"800ca32c-1bc1-4912-ade9-868855facacc","Type":"ContainerDied","Data":"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"}
Jul 06 03:07:40.233094 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.233080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6" event={"ID":"800ca32c-1bc1-4912-ade9-868855facacc","Type":"ContainerDied","Data":"b60bc670d6f94dc77e32eac8813c54b18824bee269f27d0f732fd9f6f394a97b"}
Jul 06 03:07:40.233157 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.233124    2557 scope.go:117] "RemoveContainer" containerID="9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"
Jul 06 03:07:40.241825 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.241807    2557 scope.go:117] "RemoveContainer" containerID="9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"
Jul 06 03:07:40.242075 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:07:40.242057    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a\": container with ID starting with 9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a not found: ID does not exist" containerID="9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"
Jul 06 03:07:40.242130 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.242086    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a"} err="failed to get container status \"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a\": rpc error: code = NotFound desc = could not find container \"9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a\": container with ID starting with 9f410fe15b3b3cda854b65183247ebe2cac20d1792ab64316c2d3089dffb476a not found: ID does not exist"
Jul 06 03:07:40.244432 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.244410    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls\") pod \"800ca32c-1bc1-4912-ade9-868855facacc\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") "
Jul 06 03:07:40.244544 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.244532    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca\") pod \"800ca32c-1bc1-4912-ade9-868855facacc\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") "
Jul 06 03:07:40.244585 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.244552    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdmhz\" (UniqueName: \"kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz\") pod \"800ca32c-1bc1-4912-ade9-868855facacc\" (UID: \"800ca32c-1bc1-4912-ade9-868855facacc\") "
Jul 06 03:07:40.244829 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.244809    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "800ca32c-1bc1-4912-ade9-868855facacc" (UID: "800ca32c-1bc1-4912-ade9-868855facacc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:07:40.246412 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.246391    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "800ca32c-1bc1-4912-ade9-868855facacc" (UID: "800ca32c-1bc1-4912-ade9-868855facacc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:07:40.246539 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.246519    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz" (OuterVolumeSpecName: "kube-api-access-fdmhz") pod "800ca32c-1bc1-4912-ade9-868855facacc" (UID: "800ca32c-1bc1-4912-ade9-868855facacc"). InnerVolumeSpecName "kube-api-access-fdmhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:07:40.345734 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.345701    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800ca32c-1bc1-4912-ade9-868855facacc-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:40.345734 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.345732    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdmhz\" (UniqueName: \"kubernetes.io/projected/800ca32c-1bc1-4912-ade9-868855facacc-kube-api-access-fdmhz\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:40.345734 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.345741    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800ca32c-1bc1-4912-ade9-868855facacc-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:40.557531 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.557494    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:40.561338 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:40.561306    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-8d603a52-5bf676455c-5t4z6"]
Jul 06 03:07:42.231250 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:42.231214    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800ca32c-1bc1-4912-ade9-868855facacc" path="/var/lib/kubelet/pods/800ca32c-1bc1-4912-ade9-868855facacc/volumes"
Jul 06 03:07:46.912587 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:46.912564    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:47.016899 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.016899 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016884    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016921    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkt94\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016949    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016981    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.016996    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017095    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017133    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo\") pod \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\" (UID: \"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e\") "
Jul 06 03:07:47.017423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017088    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:07:47.017423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017318    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:07:47.017423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017343    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:07:47.017676 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017537    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-credential-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.017676 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017554    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istiod-ca-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.017676 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017568    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.017676 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.017588    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:07:47.018064 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.018036    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:07:47.019396 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.019368    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94" (OuterVolumeSpecName: "kube-api-access-gkt94") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "kube-api-access-gkt94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:07:47.019537 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.019449    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:07:47.019623 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.019597    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 03:07:47.019673 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.019640    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" (UID: "1fd3a57f-01a3-452c-b17c-538a9c1b8c0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:07:47.068442 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068411    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:47.068892 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068875    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" containerName="istio-proxy"
Jul 06 03:07:47.068892 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068891    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" containerName="istio-proxy"
Jul 06 03:07:47.069046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068908    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800ca32c-1bc1-4912-ade9-868855facacc" containerName="maas-api"
Jul 06 03:07:47.069046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068917    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="800ca32c-1bc1-4912-ade9-868855facacc" containerName="maas-api"
Jul 06 03:07:47.069046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068982    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" containerName="istio-proxy"
Jul 06 03:07:47.069046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.068999    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="800ca32c-1bc1-4912-ade9-868855facacc" containerName="maas-api"
Jul 06 03:07:47.072454 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.072435    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.074754 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.074731    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-3fa4e34a-serving-cert\""
Jul 06 03:07:47.084453 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.084432    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:47.119158 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119125    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.119158 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119152    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-envoy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.119158 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119162    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-workload-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.119389 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119171    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-podinfo\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.119389 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119179    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-istio-data\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.119389 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.119199    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkt94\" (UniqueName: \"kubernetes.io/projected/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e-kube-api-access-gkt94\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:47.220612 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.220575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.220772 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.220645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgkms\" (UniqueName: \"kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.220772 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.220694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.282321 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.282231    2557 generic.go:356] "Generic (PLEG): container finished" podID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" containerID="2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c" exitCode=0
Jul 06 03:07:47.282321 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.282286    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"
Jul 06 03:07:47.282321 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.282304    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" event={"ID":"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e","Type":"ContainerDied","Data":"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"}
Jul 06 03:07:47.282609 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.282345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh" event={"ID":"1fd3a57f-01a3-452c-b17c-538a9c1b8c0e","Type":"ContainerDied","Data":"78b101d8d5fac08075bef022ca8bd8338a7f2cc3b9682c471143ee4d615b5405"}
Jul 06 03:07:47.282609 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.282366    2557 scope.go:117] "RemoveContainer" containerID="2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"
Jul 06 03:07:47.291781 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.291765    2557 scope.go:117] "RemoveContainer" containerID="2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"
Jul 06 03:07:47.292051 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:07:47.292033    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c\": container with ID starting with 2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c not found: ID does not exist" containerID="2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"
Jul 06 03:07:47.292113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.292063    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c"} err="failed to get container status \"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c\": rpc error: code = NotFound desc = could not find container \"2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c\": container with ID starting with 2642307fa30769a06a0293bdce7949e7e789bdcb39fa369b2710198dfc5e500c not found: ID does not exist"
Jul 06 03:07:47.305483 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.305452    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:47.309267 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.309246    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8d603a52-openshift-default-59d8ccdd5-7mzsh"]
Jul 06 03:07:47.322257 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.322234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.322362 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.322311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkms\" (UniqueName: \"kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.322362 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.322348    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.322973 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.322948    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.324926 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.324907    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.330665 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.330643    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgkms\" (UniqueName: \"kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms\") pod \"maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") " pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.386386 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.386362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:47.530340 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:47.530297    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:47.540310 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:07:47.540265    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242a2a02_2409_46a3_aad4_f15e79589e39.slice/crio-58fa740699ccfe7a0c71da6f11acb08738d0523da28885d9de539b4878797b50 WatchSource:0}: Error finding container 58fa740699ccfe7a0c71da6f11acb08738d0523da28885d9de539b4878797b50: Status 404 returned error can't find the container with id 58fa740699ccfe7a0c71da6f11acb08738d0523da28885d9de539b4878797b50
Jul 06 03:07:48.231706 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:48.231676    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fd3a57f-01a3-452c-b17c-538a9c1b8c0e" path="/var/lib/kubelet/pods/1fd3a57f-01a3-452c-b17c-538a9c1b8c0e/volumes"
Jul 06 03:07:48.288239 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:48.288196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" event={"ID":"242a2a02-2409-46a3-aad4-f15e79589e39","Type":"ContainerStarted","Data":"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"}
Jul 06 03:07:48.288396 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:48.288269    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:48.288396 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:48.288293    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" event={"ID":"242a2a02-2409-46a3-aad4-f15e79589e39","Type":"ContainerStarted","Data":"58fa740699ccfe7a0c71da6f11acb08738d0523da28885d9de539b4878797b50"}
Jul 06 03:07:48.306194 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:48.306140    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" podStartSLOduration=0.991594012 podStartE2EDuration="1.3061205s" totalImagesPullingTime="314.526488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:07:48.305452743 +0000 UTC m=+1702.656655065" watchObservedRunningTime="2026-07-06 03:07:48.3061205 +0000 UTC m=+1702.657322812"
Jul 06 03:07:52.534773 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.534739    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:52.535224 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.535037    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" podUID="242a2a02-2409-46a3-aad4-f15e79589e39" containerName="maas-api" containerID="cri-o://752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e" gracePeriod=30
Jul 06 03:07:52.541207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.541181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:52.787960 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.787900    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:52.873218 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.873195    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls\") pod \"242a2a02-2409-46a3-aad4-f15e79589e39\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") "
Jul 06 03:07:52.873354 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.873269    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgkms\" (UniqueName: \"kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms\") pod \"242a2a02-2409-46a3-aad4-f15e79589e39\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") "
Jul 06 03:07:52.873354 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.873312    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca\") pod \"242a2a02-2409-46a3-aad4-f15e79589e39\" (UID: \"242a2a02-2409-46a3-aad4-f15e79589e39\") "
Jul 06 03:07:52.873701 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.873673    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "242a2a02-2409-46a3-aad4-f15e79589e39" (UID: "242a2a02-2409-46a3-aad4-f15e79589e39"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:07:52.875207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.875181    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "242a2a02-2409-46a3-aad4-f15e79589e39" (UID: "242a2a02-2409-46a3-aad4-f15e79589e39"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:07:52.875303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.875229    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms" (OuterVolumeSpecName: "kube-api-access-cgkms") pod "242a2a02-2409-46a3-aad4-f15e79589e39" (UID: "242a2a02-2409-46a3-aad4-f15e79589e39"). InnerVolumeSpecName "kube-api-access-cgkms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:07:52.974207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.974180    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242a2a02-2409-46a3-aad4-f15e79589e39-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:52.974207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.974205    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242a2a02-2409-46a3-aad4-f15e79589e39-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:52.974355 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:52.974214    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgkms\" (UniqueName: \"kubernetes.io/projected/242a2a02-2409-46a3-aad4-f15e79589e39-kube-api-access-cgkms\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:07:53.315115 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.315084    2557 generic.go:356] "Generic (PLEG): container finished" podID="242a2a02-2409-46a3-aad4-f15e79589e39" containerID="752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e" exitCode=0
Jul 06 03:07:53.315274 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.315152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" event={"ID":"242a2a02-2409-46a3-aad4-f15e79589e39","Type":"ContainerDied","Data":"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"}
Jul 06 03:07:53.315274 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.315200    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"
Jul 06 03:07:53.315274 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.315211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh" event={"ID":"242a2a02-2409-46a3-aad4-f15e79589e39","Type":"ContainerDied","Data":"58fa740699ccfe7a0c71da6f11acb08738d0523da28885d9de539b4878797b50"}
Jul 06 03:07:53.315274 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.315233    2557 scope.go:117] "RemoveContainer" containerID="752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"
Jul 06 03:07:53.324612 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.324579    2557 scope.go:117] "RemoveContainer" containerID="752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"
Jul 06 03:07:53.324818 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:07:53.324799    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e\": container with ID starting with 752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e not found: ID does not exist" containerID="752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"
Jul 06 03:07:53.324869 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.324825    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e"} err="failed to get container status \"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e\": rpc error: code = NotFound desc = could not find container \"752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e\": container with ID starting with 752d909da23f3f030dbef98c68afccbc58bf0c931c85ba352d9e894059a45e9e not found: ID does not exist"
Jul 06 03:07:53.337858 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.337832    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:53.342136 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:53.342114    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-3fa4e34a-8c6d95b67-s87lh"]
Jul 06 03:07:54.230422 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:07:54.230391    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242a2a02-2409-46a3-aad4-f15e79589e39" path="/var/lib/kubelet/pods/242a2a02-2409-46a3-aad4-f15e79589e39/volumes"
Jul 06 03:08:04.479666 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.479632    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:04.480298 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.480278    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242a2a02-2409-46a3-aad4-f15e79589e39" containerName="maas-api"
Jul 06 03:08:04.480381 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.480301    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="242a2a02-2409-46a3-aad4-f15e79589e39" containerName="maas-api"
Jul 06 03:08:04.480447 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.480410    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="242a2a02-2409-46a3-aad4-f15e79589e39" containerName="maas-api"
Jul 06 03:08:04.483725 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.483701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.486243 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.486220    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0ad76d6e-openshift-default-dockercfg-skscw\""
Jul 06 03:08:04.494193 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.494167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:04.582813 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.582779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.582964 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.582845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.582964 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.582886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.582964 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.582945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.583071 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.583023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n89s7\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.583105 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.583079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.583196 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.583168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.583232 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.583214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.583277 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.583260    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684082 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n89s7\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684240 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684240 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684314 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684314 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684395 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684513 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684591 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684652 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684705 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684757 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684710    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684832 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684816    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.684955 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.684935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.686609 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.686576    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.686727 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.686711    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.692617 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.692596    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.692923 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.692903    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n89s7\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7\") pod \"e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") " pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.795682 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.795621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:04.929801 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.929774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:04.931906 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:08:04.931879    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea52c09_d92c_44f2_91ed_d6814dfa263c.slice/crio-0654ad324c62afd55523dea51ae92b5d0b7c3dc996ed443cad3f8502bc4cb905 WatchSource:0}: Error finding container 0654ad324c62afd55523dea51ae92b5d0b7c3dc996ed443cad3f8502bc4cb905: Status 404 returned error can't find the container with id 0654ad324c62afd55523dea51ae92b5d0b7c3dc996ed443cad3f8502bc4cb905
Jul 06 03:08:04.934184 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.934144    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:08:04.934261 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.934228    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:08:04.934299 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:04.934270    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:08:05.381487 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.381443    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" event={"ID":"1ea52c09-d92c-44f2-91ed-d6814dfa263c","Type":"ContainerStarted","Data":"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"}
Jul 06 03:08:05.381668 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.381525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" event={"ID":"1ea52c09-d92c-44f2-91ed-d6814dfa263c","Type":"ContainerStarted","Data":"0654ad324c62afd55523dea51ae92b5d0b7c3dc996ed443cad3f8502bc4cb905"}
Jul 06 03:08:05.401715 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.401669    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" podStartSLOduration=1.4016555529999999 podStartE2EDuration="1.401655553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:08:05.399315676 +0000 UTC m=+1719.750518014" watchObservedRunningTime="2026-07-06 03:08:05.401655553 +0000 UTC m=+1719.752857849"
Jul 06 03:08:05.752882 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.752842    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:05.756830 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.756810    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.759272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.759245    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-0ad76d6e-serving-cert\""
Jul 06 03:08:05.768581 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.768560    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:05.795968 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.795946    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:05.801020 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.800999    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:05.897413 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.897372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.897640 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.897445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xqn7\" (UniqueName: \"kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.897640 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.897601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.998334 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.998300    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xqn7\" (UniqueName: \"kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.998526 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.998368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.998526 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.998405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:05.998665 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:08:05.998535    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-0ad76d6e-serving-cert: secret "maas-api-e2e-derive-0ad76d6e-serving-cert" not found
Jul 06 03:08:05.998665 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:08:05.998595    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls podName:af4e91f7-1710-4a9d-b7ee-e5d555db1358 nodeName:}" failed. No retries permitted until 2026-07-06 03:08:06.49857791 +0000 UTC m=+1720.849780183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls") pod "maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" (UID: "af4e91f7-1710-4a9d-b7ee-e5d555db1358") : secret "maas-api-e2e-derive-0ad76d6e-serving-cert" not found
Jul 06 03:08:05.998987 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:05.998969    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:06.014914 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.014854    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xqn7\" (UniqueName: \"kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:06.387092 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.387012    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:06.388083 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.388054    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:06.504292 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.504258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:06.506488 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.506451    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") pod \"maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") " pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:06.670835 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.670755    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:06.817612 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:06.817586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:06.819171 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:08:06.819141    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4e91f7_1710_4a9d_b7ee_e5d555db1358.slice/crio-a26e9369e2f90e9eca4dc825b0b45b21f01fad7ceef022e32b6570aaebca46ee WatchSource:0}: Error finding container a26e9369e2f90e9eca4dc825b0b45b21f01fad7ceef022e32b6570aaebca46ee: Status 404 returned error can't find the container with id a26e9369e2f90e9eca4dc825b0b45b21f01fad7ceef022e32b6570aaebca46ee
Jul 06 03:08:07.394646 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:07.394611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" event={"ID":"af4e91f7-1710-4a9d-b7ee-e5d555db1358","Type":"ContainerStarted","Data":"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"}
Jul 06 03:08:07.394802 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:07.394662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" event={"ID":"af4e91f7-1710-4a9d-b7ee-e5d555db1358","Type":"ContainerStarted","Data":"a26e9369e2f90e9eca4dc825b0b45b21f01fad7ceef022e32b6570aaebca46ee"}
Jul 06 03:08:07.394802 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:07.394711    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:07.412910 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:07.412866    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" podStartSLOduration=2.051856845 podStartE2EDuration="2.412851346s" totalImagesPullingTime="360.994501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:08:07.411925555 +0000 UTC m=+1721.763127871" watchObservedRunningTime="2026-07-06 03:08:07.412851346 +0000 UTC m=+1721.764053646"
Jul 06 03:08:10.310358 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.310325    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:10.310790 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.310552    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" podUID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" containerName="istio-proxy" containerID="cri-o://e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304" gracePeriod=30
Jul 06 03:08:10.530315 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.530278    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:10.530562 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.530536    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" podUID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" containerName="maas-api" containerID="cri-o://cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908" gracePeriod=30
Jul 06 03:08:10.821458 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.821427    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:10.946901 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.946878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") pod \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") "
Jul 06 03:08:10.947049 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.946977    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xqn7\" (UniqueName: \"kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7\") pod \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") "
Jul 06 03:08:10.947049 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.946999    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca\") pod \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\" (UID: \"af4e91f7-1710-4a9d-b7ee-e5d555db1358\") "
Jul 06 03:08:10.947361 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.947336    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af4e91f7-1710-4a9d-b7ee-e5d555db1358" (UID: "af4e91f7-1710-4a9d-b7ee-e5d555db1358"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:08:10.967665 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.961264    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7" (OuterVolumeSpecName: "kube-api-access-5xqn7") pod "af4e91f7-1710-4a9d-b7ee-e5d555db1358" (UID: "af4e91f7-1710-4a9d-b7ee-e5d555db1358"). InnerVolumeSpecName "kube-api-access-5xqn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:08:10.967665 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:10.963566    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af4e91f7-1710-4a9d-b7ee-e5d555db1358" (UID: "af4e91f7-1710-4a9d-b7ee-e5d555db1358"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:08:11.048414 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.048378    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af4e91f7-1710-4a9d-b7ee-e5d555db1358-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:11.048625 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.048412    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xqn7\" (UniqueName: \"kubernetes.io/projected/af4e91f7-1710-4a9d-b7ee-e5d555db1358-kube-api-access-5xqn7\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:11.048625 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.048442    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af4e91f7-1710-4a9d-b7ee-e5d555db1358-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:11.417827 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.417741    2557 generic.go:356] "Generic (PLEG): container finished" podID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" containerID="cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908" exitCode=0
Jul 06 03:08:11.417827 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.417781    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"
Jul 06 03:08:11.417827 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.417809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" event={"ID":"af4e91f7-1710-4a9d-b7ee-e5d555db1358","Type":"ContainerDied","Data":"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"}
Jul 06 03:08:11.418303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.417851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq" event={"ID":"af4e91f7-1710-4a9d-b7ee-e5d555db1358","Type":"ContainerDied","Data":"a26e9369e2f90e9eca4dc825b0b45b21f01fad7ceef022e32b6570aaebca46ee"}
Jul 06 03:08:11.418303 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.417871    2557 scope.go:117] "RemoveContainer" containerID="cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"
Jul 06 03:08:11.427876 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.427852    2557 scope.go:117] "RemoveContainer" containerID="cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"
Jul 06 03:08:11.428125 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:08:11.428103    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908\": container with ID starting with cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908 not found: ID does not exist" containerID="cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"
Jul 06 03:08:11.428184 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.428137    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908"} err="failed to get container status \"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908\": rpc error: code = NotFound desc = could not find container \"cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908\": container with ID starting with cf7ebec96c9e557045976506b0806cb65294f30dcbc8dc6410ef2e66f9055908 not found: ID does not exist"
Jul 06 03:08:11.439118 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.439095    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:11.443044 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:11.443024    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-0ad76d6e-5d4f4c4c98-kzfvq"]
Jul 06 03:08:12.231015 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:12.230977    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" path="/var/lib/kubelet/pods/af4e91f7-1710-4a9d-b7ee-e5d555db1358/volumes"
Jul 06 03:08:15.769617 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.769594    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:15.915787 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.915720    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.915787 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.915780    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916004 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.915799    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n89s7\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916004 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.915907    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916004 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.915944    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916116 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.916037    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916116 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.916070    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916116 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.916109    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.916223 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.916131    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert\") pod \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\" (UID: \"1ea52c09-d92c-44f2-91ed-d6814dfa263c\") "
Jul 06 03:08:15.918010 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.917986    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:08:15.920068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.919726    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:08:15.920068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.919748    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:08:15.920068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.919859    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:08:15.920068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.919887    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:08:15.921584 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.921558    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7" (OuterVolumeSpecName: "kube-api-access-n89s7") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "kube-api-access-n89s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:08:15.921749 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.921724    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:08:15.922012 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.921983    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 03:08:15.922012 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:15.921991    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ea52c09-d92c-44f2-91ed-d6814dfa263c" (UID: "1ea52c09-d92c-44f2-91ed-d6814dfa263c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:08:16.017817 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017792    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-envoy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017817 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017813    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017823    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-podinfo\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017832    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istiod-ca-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017840    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-data\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017847    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-workload-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017854    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n89s7\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-kube-api-access-n89s7\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017862    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea52c09-d92c-44f2-91ed-d6814dfa263c-istio-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.017958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.017870    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea52c09-d92c-44f2-91ed-d6814dfa263c-credential-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:08:16.450339 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.450301    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" containerID="e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304" exitCode=0
Jul 06 03:08:16.450525 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.450357    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"
Jul 06 03:08:16.450525 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.450385    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" event={"ID":"1ea52c09-d92c-44f2-91ed-d6814dfa263c","Type":"ContainerDied","Data":"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"}
Jul 06 03:08:16.450525 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.450441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq" event={"ID":"1ea52c09-d92c-44f2-91ed-d6814dfa263c","Type":"ContainerDied","Data":"0654ad324c62afd55523dea51ae92b5d0b7c3dc996ed443cad3f8502bc4cb905"}
Jul 06 03:08:16.450525 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.450486    2557 scope.go:117] "RemoveContainer" containerID="e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"
Jul 06 03:08:16.459325 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.459310    2557 scope.go:117] "RemoveContainer" containerID="e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"
Jul 06 03:08:16.459623 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:08:16.459599    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304\": container with ID starting with e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304 not found: ID does not exist" containerID="e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"
Jul 06 03:08:16.459699 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.459629    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304"} err="failed to get container status \"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304\": rpc error: code = NotFound desc = could not find container \"e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304\": container with ID starting with e1f0718981406ae034b5d7f9d447e5f699c1a4862bb418d22b896524c8ca5304 not found: ID does not exist"
Jul 06 03:08:16.482567 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.482543    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:16.493861 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:16.493801    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0ad76d6e-openshift-default-785bfd5779-7qqsq"]
Jul 06 03:08:18.230321 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:08:18.230286    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" path="/var/lib/kubelet/pods/1ea52c09-d92c-44f2-91ed-d6814dfa263c/volumes"
Jul 06 03:09:26.275168 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:26.275143    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:09:26.282608 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:26.282587    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:09:54.216682 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.216638    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:09:54.217093 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217079    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" containerName="istio-proxy"
Jul 06 03:09:54.217093 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217093    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" containerName="istio-proxy"
Jul 06 03:09:54.217169 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217110    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" containerName="maas-api"
Jul 06 03:09:54.217169 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217116    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" containerName="maas-api"
Jul 06 03:09:54.217240 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217174    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea52c09-d92c-44f2-91ed-d6814dfa263c" containerName="istio-proxy"
Jul 06 03:09:54.217240 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.217183    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af4e91f7-1710-4a9d-b7ee-e5d555db1358" containerName="maas-api"
Jul 06 03:09:54.219599 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.219579    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.221820 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.221798    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ebf514bc-serving-cert\""
Jul 06 03:09:54.231746 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.231726    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:09:54.312866 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.312840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.312999 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.312905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.313045 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.313008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk8j4\" (UniqueName: \"kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.413864 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.413837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk8j4\" (UniqueName: \"kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.414033 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.413936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.414033 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.413981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.414223 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:09:54.414091    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-ebf514bc-serving-cert: secret "maas-api-e2e-mt-ebf514bc-serving-cert" not found
Jul 06 03:09:54.414223 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:09:54.414177    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls podName:7bc42506-d14f-49e5-b98c-2ee90fe33d13 nodeName:}" failed. No retries permitted until 2026-07-06 03:09:54.914156673 +0000 UTC m=+1829.265358946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls") pod "maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" (UID: "7bc42506-d14f-49e5-b98c-2ee90fe33d13") : secret "maas-api-e2e-mt-ebf514bc-serving-cert" not found
Jul 06 03:09:54.414547 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.414529    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.423887 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.423867    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk8j4\" (UniqueName: \"kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.919402 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.919368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:54.921871 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:54.921838    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") pod \"maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") " pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:55.131567 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.131536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:55.269449 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.269421    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:09:55.271696 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:09:55.271651    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc42506_d14f_49e5_b98c_2ee90fe33d13.slice/crio-c44edadc18bf3015c2b6c7a30631eddcf5b6c1763ca161921b26a3df437b9c27 WatchSource:0}: Error finding container c44edadc18bf3015c2b6c7a30631eddcf5b6c1763ca161921b26a3df437b9c27: Status 404 returned error can't find the container with id c44edadc18bf3015c2b6c7a30631eddcf5b6c1763ca161921b26a3df437b9c27
Jul 06 03:09:55.977285 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.977248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" event={"ID":"7bc42506-d14f-49e5-b98c-2ee90fe33d13","Type":"ContainerStarted","Data":"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"}
Jul 06 03:09:55.977502 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.977305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" event={"ID":"7bc42506-d14f-49e5-b98c-2ee90fe33d13","Type":"ContainerStarted","Data":"c44edadc18bf3015c2b6c7a30631eddcf5b6c1763ca161921b26a3df437b9c27"}
Jul 06 03:09:55.977502 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.977379    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:09:55.992923 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:09:55.992874    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" podStartSLOduration=1.6260868149999999 podStartE2EDuration="1.992857286s" totalImagesPullingTime="366.770471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:09:55.992558948 +0000 UTC m=+1830.343761268" watchObservedRunningTime="2026-07-06 03:09:55.992857286 +0000 UTC m=+1830.344059583"
Jul 06 03:10:01.989449 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:01.989419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:10:06.461499 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.460130    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:10:06.461499 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.460627    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" podUID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" containerName="maas-api" containerID="cri-o://eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1" gracePeriod=30
Jul 06 03:10:06.725732 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.725675    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:10:06.833540 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.833505    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") pod \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") "
Jul 06 03:10:06.833742 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.833580    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk8j4\" (UniqueName: \"kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4\") pod \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") "
Jul 06 03:10:06.833742 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.833700    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca\") pod \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\" (UID: \"7bc42506-d14f-49e5-b98c-2ee90fe33d13\") "
Jul 06 03:10:06.834109 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.834082    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7bc42506-d14f-49e5-b98c-2ee90fe33d13" (UID: "7bc42506-d14f-49e5-b98c-2ee90fe33d13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:10:06.835647 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.835624    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7bc42506-d14f-49e5-b98c-2ee90fe33d13" (UID: "7bc42506-d14f-49e5-b98c-2ee90fe33d13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:10:06.835738 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.835673    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4" (OuterVolumeSpecName: "kube-api-access-bk8j4") pod "7bc42506-d14f-49e5-b98c-2ee90fe33d13" (UID: "7bc42506-d14f-49e5-b98c-2ee90fe33d13"). InnerVolumeSpecName "kube-api-access-bk8j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:10:06.935124 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.935095    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bc42506-d14f-49e5-b98c-2ee90fe33d13-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:10:06.935124 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.935122    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk8j4\" (UniqueName: \"kubernetes.io/projected/7bc42506-d14f-49e5-b98c-2ee90fe33d13-kube-api-access-bk8j4\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:10:06.935304 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:06.935132    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bc42506-d14f-49e5-b98c-2ee90fe33d13-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:10:07.033509 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.033398    2557 generic.go:356] "Generic (PLEG): container finished" podID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" containerID="eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1" exitCode=0
Jul 06 03:10:07.033509 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.033446    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"
Jul 06 03:10:07.033718 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.033507    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" event={"ID":"7bc42506-d14f-49e5-b98c-2ee90fe33d13","Type":"ContainerDied","Data":"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"}
Jul 06 03:10:07.033718 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.033565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz" event={"ID":"7bc42506-d14f-49e5-b98c-2ee90fe33d13","Type":"ContainerDied","Data":"c44edadc18bf3015c2b6c7a30631eddcf5b6c1763ca161921b26a3df437b9c27"}
Jul 06 03:10:07.033718 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.033595    2557 scope.go:117] "RemoveContainer" containerID="eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"
Jul 06 03:10:07.043185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.043169    2557 scope.go:117] "RemoveContainer" containerID="eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"
Jul 06 03:10:07.043434 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:10:07.043413    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1\": container with ID starting with eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1 not found: ID does not exist" containerID="eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"
Jul 06 03:10:07.043504 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.043442    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1"} err="failed to get container status \"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1\": rpc error: code = NotFound desc = could not find container \"eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1\": container with ID starting with eebe900964cd17f82903095a1c08bfde00a75d7690fed7ba5c6f836115d8a5c1 not found: ID does not exist"
Jul 06 03:10:07.055669 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.055644    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:10:07.060025 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:07.060003    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ebf514bc-665b85c9c9-xdpwz"]
Jul 06 03:10:08.230821 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:08.230778    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" path="/var/lib/kubelet/pods/7bc42506-d14f-49e5-b98c-2ee90fe33d13/volumes"
Jul 06 03:10:35.353747 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.353716    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:10:35.354210 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.354121    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" containerName="maas-api"
Jul 06 03:10:35.354210 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.354133    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" containerName="maas-api"
Jul 06 03:10:35.354210 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.354204    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc42506-d14f-49e5-b98c-2ee90fe33d13" containerName="maas-api"
Jul 06 03:10:35.357443 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.357419    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.359972 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.359948    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-7b6582bb-serving-cert\""
Jul 06 03:10:35.366403 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.366379    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:10:35.394898 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.394874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.395028 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.394912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rph4q\" (UniqueName: \"kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.395028 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.394944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.496280 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.496249    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.496436 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.496345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.496436 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.496371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rph4q\" (UniqueName: \"kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.496716 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:10:35.496513    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-7b6582bb-serving-cert: secret "maas-api-e2e-mt-7b6582bb-serving-cert" not found
Jul 06 03:10:35.496716 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:10:35.496600    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls podName:69a8c237-bb35-4382-a2aa-808670edd7df nodeName:}" failed. No retries permitted until 2026-07-06 03:10:35.996575136 +0000 UTC m=+1870.347777412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls") pod "maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" (UID: "69a8c237-bb35-4382-a2aa-808670edd7df") : secret "maas-api-e2e-mt-7b6582bb-serving-cert" not found
Jul 06 03:10:35.497012 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.496994    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:35.507569 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:35.507546    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rph4q\" (UniqueName: \"kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:36.000852 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:36.000816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:36.003220 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:36.003198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") pod \"maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") " pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:36.270218 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:36.270135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:36.411451 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:36.411273    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:10:36.413985 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:10:36.413958    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a8c237_bb35_4382_a2aa_808670edd7df.slice/crio-0fb2c3a0c44b867fa25fb9a2f1cb771a3360fbe365acccfcc5a04e611b233eed WatchSource:0}: Error finding container 0fb2c3a0c44b867fa25fb9a2f1cb771a3360fbe365acccfcc5a04e611b233eed: Status 404 returned error can't find the container with id 0fb2c3a0c44b867fa25fb9a2f1cb771a3360fbe365acccfcc5a04e611b233eed
Jul 06 03:10:37.196040 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:37.196002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" event={"ID":"69a8c237-bb35-4382-a2aa-808670edd7df","Type":"ContainerStarted","Data":"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"}
Jul 06 03:10:37.196233 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:37.196089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" event={"ID":"69a8c237-bb35-4382-a2aa-808670edd7df","Type":"ContainerStarted","Data":"0fb2c3a0c44b867fa25fb9a2f1cb771a3360fbe365acccfcc5a04e611b233eed"}
Jul 06 03:10:37.196233 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:37.196117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:10:37.214520 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:37.214455    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" podStartSLOduration=1.862156447 podStartE2EDuration="2.214439939s" totalImagesPullingTime="352.283492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:10:37.212131118 +0000 UTC m=+1871.563333445" watchObservedRunningTime="2026-07-06 03:10:37.214439939 +0000 UTC m=+1871.565642269"
Jul 06 03:10:43.206692 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:10:43.206661    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:11:22.814164 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:22.814073    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:11:22.814769 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:22.814330    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" podUID="69a8c237-bb35-4382-a2aa-808670edd7df" containerName="maas-api" containerID="cri-o://2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998" gracePeriod=30
Jul 06 03:11:23.070115 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.070056    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:11:23.141654 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.141625    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca\") pod \"69a8c237-bb35-4382-a2aa-808670edd7df\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") "
Jul 06 03:11:23.141828 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.141670    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") pod \"69a8c237-bb35-4382-a2aa-808670edd7df\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") "
Jul 06 03:11:23.141828 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.141769    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rph4q\" (UniqueName: \"kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q\") pod \"69a8c237-bb35-4382-a2aa-808670edd7df\" (UID: \"69a8c237-bb35-4382-a2aa-808670edd7df\") "
Jul 06 03:11:23.142011 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.141982    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69a8c237-bb35-4382-a2aa-808670edd7df" (UID: "69a8c237-bb35-4382-a2aa-808670edd7df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:11:23.143859 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.143834    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69a8c237-bb35-4382-a2aa-808670edd7df" (UID: "69a8c237-bb35-4382-a2aa-808670edd7df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:11:23.143938 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.143894    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q" (OuterVolumeSpecName: "kube-api-access-rph4q") pod "69a8c237-bb35-4382-a2aa-808670edd7df" (UID: "69a8c237-bb35-4382-a2aa-808670edd7df"). InnerVolumeSpecName "kube-api-access-rph4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:11:23.243142 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.243096    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rph4q\" (UniqueName: \"kubernetes.io/projected/69a8c237-bb35-4382-a2aa-808670edd7df-kube-api-access-rph4q\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:11:23.243142 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.243138    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69a8c237-bb35-4382-a2aa-808670edd7df-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:11:23.243142 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.243148    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69a8c237-bb35-4382-a2aa-808670edd7df-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:11:23.423014 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.422898    2557 generic.go:356] "Generic (PLEG): container finished" podID="69a8c237-bb35-4382-a2aa-808670edd7df" containerID="2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998" exitCode=0
Jul 06 03:11:23.423205 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.423012    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"
Jul 06 03:11:23.423205 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.423020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" event={"ID":"69a8c237-bb35-4382-a2aa-808670edd7df","Type":"ContainerDied","Data":"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"}
Jul 06 03:11:23.423205 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.423077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b" event={"ID":"69a8c237-bb35-4382-a2aa-808670edd7df","Type":"ContainerDied","Data":"0fb2c3a0c44b867fa25fb9a2f1cb771a3360fbe365acccfcc5a04e611b233eed"}
Jul 06 03:11:23.423205 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.423113    2557 scope.go:117] "RemoveContainer" containerID="2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"
Jul 06 03:11:23.432743 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.432724    2557 scope.go:117] "RemoveContainer" containerID="2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"
Jul 06 03:11:23.433005 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:11:23.432985    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998\": container with ID starting with 2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998 not found: ID does not exist" containerID="2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"
Jul 06 03:11:23.433050 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.433016    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998"} err="failed to get container status \"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998\": rpc error: code = NotFound desc = could not find container \"2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998\": container with ID starting with 2c9c00c48b7969c3769d02bf9383bef0b1998d5f7b2145f68bbaf0d4055db998 not found: ID does not exist"
Jul 06 03:11:23.444947 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.444925    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:11:23.450273 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:23.450242    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-7b6582bb-557b6cf76f-ljj5b"]
Jul 06 03:11:24.232045 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:11:24.232012    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a8c237-bb35-4382-a2aa-808670edd7df" path="/var/lib/kubelet/pods/69a8c237-bb35-4382-a2aa-808670edd7df/volumes"
Jul 06 03:13:14.203419 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.203383    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:13:14.204087 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.204071    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a8c237-bb35-4382-a2aa-808670edd7df" containerName="maas-api"
Jul 06 03:13:14.204136 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.204089    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a8c237-bb35-4382-a2aa-808670edd7df" containerName="maas-api"
Jul 06 03:13:14.204185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.204172    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="69a8c237-bb35-4382-a2aa-808670edd7df" containerName="maas-api"
Jul 06 03:13:14.207587 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.207567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.210116 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.210097    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-2236bf-serving-cert\""
Jul 06 03:13:14.220091 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.220066    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:13:14.251631 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.251602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.251780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.251661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49jxq\" (UniqueName: \"kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.251780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.251720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.353177 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.353142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.353328 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.353240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49jxq\" (UniqueName: \"kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.353328 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.353288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.353938 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.353915    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.355708 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.355688    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.362870 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.362840    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49jxq\" (UniqueName: \"kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq\") pod \"maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") " pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.521873 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.521802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:14.660249 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.660218    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:13:14.661963 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:13:14.661937    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a37a1b_e43c_40bb_b4ed_9e1825035fb1.slice/crio-36f143250290f4b7cc7f43323fb00dc2510e3af566ea5f3084a6e604c6b49b83 WatchSource:0}: Error finding container 36f143250290f4b7cc7f43323fb00dc2510e3af566ea5f3084a6e604c6b49b83: Status 404 returned error can't find the container with id 36f143250290f4b7cc7f43323fb00dc2510e3af566ea5f3084a6e604c6b49b83
Jul 06 03:13:14.663407 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.663388    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 03:13:14.987802 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:14.987767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" event={"ID":"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1","Type":"ContainerStarted","Data":"36f143250290f4b7cc7f43323fb00dc2510e3af566ea5f3084a6e604c6b49b83"}
Jul 06 03:13:16.001361 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:16.001323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" event={"ID":"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1","Type":"ContainerStarted","Data":"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"}
Jul 06 03:13:16.003671 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:16.001422    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:16.018790 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:16.018750    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" podStartSLOduration=1.514444983 podStartE2EDuration="2.018737408s" totalImagesPullingTime="504.292425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:13:16.017671975 +0000 UTC m=+2030.368874271" watchObservedRunningTime="2026-07-06 03:13:16.018737408 +0000 UTC m=+2030.369939718"
Jul 06 03:13:19.176585 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.176556    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:13:19.180537 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.180514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.182848 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.182828    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dd35c6-openshift-default-dockercfg-mvqnq\""
Jul 06 03:13:19.193801 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.193779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:13:19.302449 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302659 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302659 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302659 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfmgx\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302659 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302659 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302937 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302937 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302688    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.302937 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.302741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404062 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfmgx\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404272 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404582 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404582 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404582 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404582 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404790 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404653    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404790 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404704    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.404953 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.404931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.405027 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.405009    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.406553 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.406534    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.406987 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.406969    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.412766 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.412743    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.413173 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.413157    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfmgx\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx\") pod \"e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") " pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.494980 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.494934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:19.638999 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.638968    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:13:19.640800 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:13:19.640759    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b84498e_1b28_4695_91a6_b22127124041.slice/crio-52ebcfec682ab7e13696f7e511659a473bbdd880e1ec22467ab765e3d6f89c71 WatchSource:0}: Error finding container 52ebcfec682ab7e13696f7e511659a473bbdd880e1ec22467ab765e3d6f89c71: Status 404 returned error can't find the container with id 52ebcfec682ab7e13696f7e511659a473bbdd880e1ec22467ab765e3d6f89c71
Jul 06 03:13:19.643096 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.643064    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:19.643186 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.643126    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:19.643186 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:19.643154    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:20.021865 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:20.021831    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerStarted","Data":"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"}
Jul 06 03:13:20.022042 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:20.021882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerStarted","Data":"52ebcfec682ab7e13696f7e511659a473bbdd880e1ec22467ab765e3d6f89c71"}
Jul 06 03:13:20.041491 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:20.041426    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podStartSLOduration=1.041411581 podStartE2EDuration="1.041411581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:13:20.039414705 +0000 UTC m=+2034.390617222" watchObservedRunningTime="2026-07-06 03:13:20.041411581 +0000 UTC m=+2034.392613877"
Jul 06 03:13:20.495793 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:20.495757    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:20.500733 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:20.500709    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:21.027306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:21.027277    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:21.028159 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:21.028138    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:22.012142 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.012114    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:13:22.125840 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.125806    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:13:22.129708 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.129682    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.131967 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.131943    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-dd35c6-serving-cert\""
Jul 06 03:13:22.159567 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.159105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:13:22.231710 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.231673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvbn\" (UniqueName: \"kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.231875 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.231741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.231924 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.231909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.332838 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.332721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.333014 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.332981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.333103 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.333019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvbn\" (UniqueName: \"kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.333358 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:13:22.333325    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-dd35c6-serving-cert: secret "maas-api-e2e-inf-b-dd35c6-serving-cert" not found
Jul 06 03:13:22.333508 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:13:22.333408    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls podName:0f76daf6-5530-413a-a5bc-0a23ed230bd7 nodeName:}" failed. No retries permitted until 2026-07-06 03:13:22.833385217 +0000 UTC m=+2037.184587493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls") pod "maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" (UID: "0f76daf6-5530-413a-a5bc-0a23ed230bd7") : secret "maas-api-e2e-inf-b-dd35c6-serving-cert" not found
Jul 06 03:13:22.333606 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.333577    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.341611 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.341582    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvbn\" (UniqueName: \"kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.837772 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.837736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:22.840203 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:22.840180    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") pod \"maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") " pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:23.057734 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:23.057701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:23.196792 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:23.196768    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:13:23.200418 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:13:23.200392    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f76daf6_5530_413a_a5bc_0a23ed230bd7.slice/crio-2178fd707157f70dcedbbb1c18727acae0a01a6fd8db4ce72a657cdd3ae90b2d WatchSource:0}: Error finding container 2178fd707157f70dcedbbb1c18727acae0a01a6fd8db4ce72a657cdd3ae90b2d: Status 404 returned error can't find the container with id 2178fd707157f70dcedbbb1c18727acae0a01a6fd8db4ce72a657cdd3ae90b2d
Jul 06 03:13:24.044087 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:24.044052    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" event={"ID":"0f76daf6-5530-413a-a5bc-0a23ed230bd7","Type":"ContainerStarted","Data":"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"}
Jul 06 03:13:24.044275 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:24.044106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" event={"ID":"0f76daf6-5530-413a-a5bc-0a23ed230bd7","Type":"ContainerStarted","Data":"2178fd707157f70dcedbbb1c18727acae0a01a6fd8db4ce72a657cdd3ae90b2d"}
Jul 06 03:13:24.044275 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:24.044137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:24.059273 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:24.059228    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" podStartSLOduration=1.6792124560000001 podStartE2EDuration="2.059212777s" totalImagesPullingTime="380.000321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:13:24.05817587 +0000 UTC m=+2038.409378167" watchObservedRunningTime="2026-07-06 03:13:24.059212777 +0000 UTC m=+2038.410415077"
Jul 06 03:13:30.055300 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:30.055271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:13:37.068632 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:37.068587    2557 patch_prober.go:28] interesting pod/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 03:13:37.069051 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:37.068664    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 03:13:38.123083 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.123047    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b84498e-1b28-4695-91a6-b22127124041" containerID="9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed" exitCode=0
Jul 06 03:13:38.123570 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.123104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerDied","Data":"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"}
Jul 06 03:13:38.123570 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.123511    2557 scope.go:117] "RemoveContainer" containerID="9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"
Jul 06 03:13:38.124590 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.124558    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:38.124663 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.124645    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:38.124701 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:38.124691    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:13:39.129668 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:39.129628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerStarted","Data":"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"}
Jul 06 03:13:39.495419 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:39.495383    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:39.495646 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:39.495623    2557 patch_prober.go:28] interesting pod/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 03:13:39.495718 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:39.495699    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 03:13:40.495831 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:40.495792    2557 patch_prober.go:28] interesting pod/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 03:13:40.496216 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:40.495871    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 03:13:41.495289 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:41.495252    2557 patch_prober.go:28] interesting pod/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 03:13:41.495497 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:41.495310    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 03:13:42.495779 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:42.495743    2557 patch_prober.go:28] interesting pod/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 03:13:42.496228 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:42.495807    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 03:13:43.498990 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:43.498961    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:43.499357 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:43.499229    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:13:43.499947 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:13:43.499932    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:14:26.311943 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:26.311915    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:14:26.319880 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:26.319859    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:14:32.174746 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.174707    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:14:32.175171 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.174969    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" podUID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" containerName="maas-api" containerID="cri-o://5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e" gracePeriod=30
Jul 06 03:14:32.635323 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.635297    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:14:32.694857 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.694832    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca\") pod \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") "
Jul 06 03:14:32.694972 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.694906    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls\") pod \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") "
Jul 06 03:14:32.695019 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.694976    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49jxq\" (UniqueName: \"kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq\") pod \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\" (UID: \"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1\") "
Jul 06 03:14:32.695244 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.695223    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" (UID: "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:14:32.695342 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.695331    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:14:32.696963 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.696940    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq" (OuterVolumeSpecName: "kube-api-access-49jxq") pod "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" (UID: "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1"). InnerVolumeSpecName "kube-api-access-49jxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:14:32.697015 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.697004    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" (UID: "d9a37a1b-e43c-40bb-b4ed-9e1825035fb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:14:32.796394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.796331    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49jxq\" (UniqueName: \"kubernetes.io/projected/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-kube-api-access-49jxq\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:14:32.796394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:32.796356    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:14:33.401340 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.401303    2557 generic.go:356] "Generic (PLEG): container finished" podID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" containerID="5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e" exitCode=0
Jul 06 03:14:33.401340 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.401345    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"
Jul 06 03:14:33.401806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.401379    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" event={"ID":"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1","Type":"ContainerDied","Data":"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"}
Jul 06 03:14:33.401806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.401429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2" event={"ID":"d9a37a1b-e43c-40bb-b4ed-9e1825035fb1","Type":"ContainerDied","Data":"36f143250290f4b7cc7f43323fb00dc2510e3af566ea5f3084a6e604c6b49b83"}
Jul 06 03:14:33.401806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.401451    2557 scope.go:117] "RemoveContainer" containerID="5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"
Jul 06 03:14:33.411654 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.411634    2557 scope.go:117] "RemoveContainer" containerID="5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"
Jul 06 03:14:33.411896 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:14:33.411875    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e\": container with ID starting with 5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e not found: ID does not exist" containerID="5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"
Jul 06 03:14:33.411964 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.411905    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e"} err="failed to get container status \"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e\": rpc error: code = NotFound desc = could not find container \"5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e\": container with ID starting with 5daaf662fdf2aaf6dd97fa2cf5ac2b181d6274511e27399a9fefb195b4cb6a6e not found: ID does not exist"
Jul 06 03:14:33.423736 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.423716    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:14:33.427008 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:33.426988    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2236bf-f5647c8b6-vw7z2"]
Jul 06 03:14:34.230519 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:14:34.230463    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" path="/var/lib/kubelet/pods/d9a37a1b-e43c-40bb-b4ed-9e1825035fb1/volumes"
Jul 06 03:15:15.103937 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.103901    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:15:15.104439 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.104143    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" podUID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" containerName="maas-api" containerID="cri-o://dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a" gracePeriod=30
Jul 06 03:15:15.357113 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.357046    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:15:15.400854 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.400823    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca\") pod \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") "
Jul 06 03:15:15.400996 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.400925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccvbn\" (UniqueName: \"kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn\") pod \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") "
Jul 06 03:15:15.400996 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.400983    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") pod \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\" (UID: \"0f76daf6-5530-413a-a5bc-0a23ed230bd7\") "
Jul 06 03:15:15.401214 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.401188    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f76daf6-5530-413a-a5bc-0a23ed230bd7" (UID: "0f76daf6-5530-413a-a5bc-0a23ed230bd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:15:15.401324 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.401309    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f76daf6-5530-413a-a5bc-0a23ed230bd7-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:15.402899 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.402876    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn" (OuterVolumeSpecName: "kube-api-access-ccvbn") pod "0f76daf6-5530-413a-a5bc-0a23ed230bd7" (UID: "0f76daf6-5530-413a-a5bc-0a23ed230bd7"). InnerVolumeSpecName "kube-api-access-ccvbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:15:15.402985 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.402935    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f76daf6-5530-413a-a5bc-0a23ed230bd7" (UID: "0f76daf6-5530-413a-a5bc-0a23ed230bd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:15:15.502012 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.501989    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccvbn\" (UniqueName: \"kubernetes.io/projected/0f76daf6-5530-413a-a5bc-0a23ed230bd7-kube-api-access-ccvbn\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:15.502012 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.502011    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f76daf6-5530-413a-a5bc-0a23ed230bd7-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:15.629550 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.629456    2557 generic.go:356] "Generic (PLEG): container finished" podID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" containerID="dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a" exitCode=0
Jul 06 03:15:15.629550 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.629510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" event={"ID":"0f76daf6-5530-413a-a5bc-0a23ed230bd7","Type":"ContainerDied","Data":"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"}
Jul 06 03:15:15.629705 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.629552    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47" event={"ID":"0f76daf6-5530-413a-a5bc-0a23ed230bd7","Type":"ContainerDied","Data":"2178fd707157f70dcedbbb1c18727acae0a01a6fd8db4ce72a657cdd3ae90b2d"}
Jul 06 03:15:15.629705 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.629575    2557 scope.go:117] "RemoveContainer" containerID="dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"
Jul 06 03:15:15.629705 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.629515    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"
Jul 06 03:15:15.642558 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.642538    2557 scope.go:117] "RemoveContainer" containerID="dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"
Jul 06 03:15:15.642808 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:15.642792    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a\": container with ID starting with dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a not found: ID does not exist" containerID="dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"
Jul 06 03:15:15.642856 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.642819    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a"} err="failed to get container status \"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a\": rpc error: code = NotFound desc = could not find container \"dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a\": container with ID starting with dcb6e513bdf680f953be7b33f96928b81136be46f52cc64ca525b5775406c32a not found: ID does not exist"
Jul 06 03:15:15.653929 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.653899    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:15:15.657932 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:15.657911    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-dd35c6-65865f747f-p5p47"]
Jul 06 03:15:16.230429 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:16.230395    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" path="/var/lib/kubelet/pods/0f76daf6-5530-413a-a5bc-0a23ed230bd7/volumes"
Jul 06 03:15:20.772254 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:20.772171    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:15:20.772711 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:20.772432    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy" containerID="cri-o://63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193" gracePeriod=30
Jul 06 03:15:24.814837 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.814801    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:24.815236 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815212    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" containerName="maas-api"
Jul 06 03:15:24.815236 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815224    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" containerName="maas-api"
Jul 06 03:15:24.815329 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815255    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" containerName="maas-api"
Jul 06 03:15:24.815329 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815260    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" containerName="maas-api"
Jul 06 03:15:24.815329 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815328    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a37a1b-e43c-40bb-b4ed-9e1825035fb1" containerName="maas-api"
Jul 06 03:15:24.815427 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.815338    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f76daf6-5530-413a-a5bc-0a23ed230bd7" containerName="maas-api"
Jul 06 03:15:24.819651 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.819632    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.822238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.822222    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-a20636-serving-cert\""
Jul 06 03:15:24.828166 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.828145    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:24.891187 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.891156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.891334 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.891201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcf5\" (UniqueName: \"kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.891334 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.891234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.991893 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.991859    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.991893 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.991898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcf5\" (UniqueName: \"kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.992142 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.991919    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:24.992142 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:24.992046    2557 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-a20636-serving-cert: secret "maas-api-e2e-api-a-a20636-serving-cert" not found
Jul 06 03:15:24.992250 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:24.992149    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls podName:d2ad47c0-09dd-4edd-b839-0ba194e1793a nodeName:}" failed. No retries permitted until 2026-07-06 03:15:25.492125432 +0000 UTC m=+2159.843327723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls") pod "maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" (UID: "d2ad47c0-09dd-4edd-b839-0ba194e1793a") : secret "maas-api-e2e-api-a-a20636-serving-cert" not found
Jul 06 03:15:24.992544 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:24.992527    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:25.002584 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:25.002562    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcf5\" (UniqueName: \"kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:25.497402 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:25.497369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:25.499828 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:25.499808    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") pod \"maas-api-e2e-api-a-a20636-5b7997f59d-t27zs\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") " pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:25.731176 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:25.731142    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:25.875452 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:25.875429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:25.877366 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:15:25.877342    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ad47c0_09dd_4edd_b839_0ba194e1793a.slice/crio-0f20a934dbf395e739d81c7c44bf12b0fb6250154fe895f09a0aa6b026a05e9d WatchSource:0}: Error finding container 0f20a934dbf395e739d81c7c44bf12b0fb6250154fe895f09a0aa6b026a05e9d: Status 404 returned error can't find the container with id 0f20a934dbf395e739d81c7c44bf12b0fb6250154fe895f09a0aa6b026a05e9d
Jul 06 03:15:26.026786 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.026760    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:15:26.104189 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104121    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfmgx\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104189 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104150    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104383 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104189    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104383 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104243    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104383 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104295    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104383 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104383 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104347    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104682 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104387    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104682 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104490    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo\") pod \"3b84498e-1b28-4695-91a6-b22127124041\" (UID: \"3b84498e-1b28-4695-91a6-b22127124041\") "
Jul 06 03:15:26.104682 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104589    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:15:26.104853 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104681    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:15:26.104853 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104688    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:15:26.104853 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.104810    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:15:26.105058 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.105039    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.105124 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.105062    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b84498e-1b28-4695-91a6-b22127124041-istiod-ca-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.105124 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.105077    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-workload-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.105124 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.105090    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-credential-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.105429 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.105411    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:15:26.106295 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.106270    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx" (OuterVolumeSpecName: "kube-api-access-dfmgx") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "kube-api-access-dfmgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:15:26.106649 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.106620    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:15:26.106814 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.106786    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:15:26.106891 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.106874    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b84498e-1b28-4695-91a6-b22127124041" (UID: "3b84498e-1b28-4695-91a6-b22127124041"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 03:15:26.205926 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.205904    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-envoy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.205926 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.205927    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b84498e-1b28-4695-91a6-b22127124041-istio-podinfo\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.206058 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.205936    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfmgx\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-kube-api-access-dfmgx\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.206058 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.205944    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b84498e-1b28-4695-91a6-b22127124041-istio-data\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.206058 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.205952    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b84498e-1b28-4695-91a6-b22127124041-istio-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:26.690830 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.690735    2557 generic.go:356] "Generic (PLEG): container finished" podID="3b84498e-1b28-4695-91a6-b22127124041" containerID="63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193" exitCode=0
Jul 06 03:15:26.690830 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.690802    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"
Jul 06 03:15:26.691068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.690822    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerDied","Data":"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"}
Jul 06 03:15:26.691068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.690878    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr" event={"ID":"3b84498e-1b28-4695-91a6-b22127124041","Type":"ContainerDied","Data":"52ebcfec682ab7e13696f7e511659a473bbdd880e1ec22467ab765e3d6f89c71"}
Jul 06 03:15:26.691068 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.690910    2557 scope.go:117] "RemoveContainer" containerID="63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"
Jul 06 03:15:26.692791 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.692762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" event={"ID":"d2ad47c0-09dd-4edd-b839-0ba194e1793a","Type":"ContainerStarted","Data":"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"}
Jul 06 03:15:26.692909 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.692823    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" event={"ID":"d2ad47c0-09dd-4edd-b839-0ba194e1793a","Type":"ContainerStarted","Data":"0f20a934dbf395e739d81c7c44bf12b0fb6250154fe895f09a0aa6b026a05e9d"}
Jul 06 03:15:26.692909 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.692866    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:26.700402 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.700378    2557 scope.go:117] "RemoveContainer" containerID="9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"
Jul 06 03:15:26.708627 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.708609    2557 scope.go:117] "RemoveContainer" containerID="63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"
Jul 06 03:15:26.708881 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:26.708859    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193\": container with ID starting with 63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193 not found: ID does not exist" containerID="63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"
Jul 06 03:15:26.708936 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.708891    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193"} err="failed to get container status \"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193\": rpc error: code = NotFound desc = could not find container \"63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193\": container with ID starting with 63432045bce88632581d63f5bc6f7217349252135a487108f8fbf9c1e80a5193 not found: ID does not exist"
Jul 06 03:15:26.708936 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.708913    2557 scope.go:117] "RemoveContainer" containerID="9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"
Jul 06 03:15:26.709168 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:26.709141    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed\": container with ID starting with 9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed not found: ID does not exist" containerID="9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"
Jul 06 03:15:26.709258 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.709171    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed"} err="failed to get container status \"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed\": rpc error: code = NotFound desc = could not find container \"9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed\": container with ID starting with 9a0a7ca1a464826e5c701069b5802d16d26633d38867ac393f2253c8672501ed not found: ID does not exist"
Jul 06 03:15:26.709517 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.709496    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:15:26.714694 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.714674    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dd35c6-openshift-default-664b5fbc6f-d84mr"]
Jul 06 03:15:26.729239 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:26.729200    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" podStartSLOduration=2.34104056 podStartE2EDuration="2.729187503s" totalImagesPullingTime="388.146943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:15:26.727875846 +0000 UTC m=+2161.079078163" watchObservedRunningTime="2026-07-06 03:15:26.729187503 +0000 UTC m=+2161.080389799"
Jul 06 03:15:28.230851 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:28.230819    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b84498e-1b28-4695-91a6-b22127124041" path="/var/lib/kubelet/pods/3b84498e-1b28-4695-91a6-b22127124041/volumes"
Jul 06 03:15:29.895346 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.895309    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:15:29.895760 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.895746    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:29.895822 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.895761    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:29.895876 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.895837    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:29.895876 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.895854    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:29.900859 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.900841    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:29.903262 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.903246    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e0113f-openshift-default-dockercfg-8fxcz\""
Jul 06 03:15:29.909411 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:29.909387    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:15:30.042399 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042399 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6cfk\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042641 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042641 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042641 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042617    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042777 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042777 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042777 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.042894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.042788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.143619 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.143806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.143806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.143806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.143806 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143702    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144029 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144029 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6cfk\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144029 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144029 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.143935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144246 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.144141    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144246 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.144184    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144368 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.144273    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144425 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.144411    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.144507 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.144415    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.146148 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.146085    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.146249 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.146203    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.151992 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.151970    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.152087 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.152038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6cfk\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk\") pod \"e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") " pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.212955 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.212935    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:30.354267 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.354238    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:15:30.355706 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:15:30.355675    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c367ffc_61cc_48be_861d_32f90ede45b1.slice/crio-b0ccd791ebde240a5efb3be2db7713a4271c974f31fda5e4adc574a700f28b03 WatchSource:0}: Error finding container b0ccd791ebde240a5efb3be2db7713a4271c974f31fda5e4adc574a700f28b03: Status 404 returned error can't find the container with id b0ccd791ebde240a5efb3be2db7713a4271c974f31fda5e4adc574a700f28b03
Jul 06 03:15:30.358060 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.358033    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:30.358132 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.358108    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:30.358171 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.358137    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:30.714753 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.714720    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerStarted","Data":"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"}
Jul 06 03:15:30.714946 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.714774    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerStarted","Data":"b0ccd791ebde240a5efb3be2db7713a4271c974f31fda5e4adc574a700f28b03"}
Jul 06 03:15:30.743104 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:30.743059    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podStartSLOduration=1.7430453190000001 podStartE2EDuration="1.743045319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:15:30.740499997 +0000 UTC m=+2165.091702299" watchObservedRunningTime="2026-07-06 03:15:30.743045319 +0000 UTC m=+2165.094247615"
Jul 06 03:15:31.213549 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:31.213513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:31.218275 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:31.218248    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:31.720529 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:31.720503    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:31.721417 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:31.721396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:32.704757 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.704728    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:32.806885 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.806853    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:32.807509 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.807493    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:32.807554 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.807514    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b84498e-1b28-4695-91a6-b22127124041" containerName="istio-proxy"
Jul 06 03:15:32.811330 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.811309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:32.813793 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.813774    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-e0113f-serving-cert\""
Jul 06 03:15:32.822981 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.822959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:32.973894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.973806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9sb\" (UniqueName: \"kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:32.973894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.973851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:32.974082 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:32.973940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.075121 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.075086    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.075286 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.075162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9sb\" (UniqueName: \"kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.075286 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.075188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.075882 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.075856    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.077544 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.077522    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.082897 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.082876    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9sb\" (UniqueName: \"kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb\") pod \"maas-api-e2e-api-b-e0113f-7746c47565-rpzpl\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") " pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.123839 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.123822    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.289416 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.289391    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:33.291937 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:15:33.291907    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439525b5_9873_4005_979e_acad5f0c2a16.slice/crio-5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb WatchSource:0}: Error finding container 5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb: Status 404 returned error can't find the container with id 5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb
Jul 06 03:15:33.732030 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.732000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" event={"ID":"439525b5-9873-4005-979e-acad5f0c2a16","Type":"ContainerStarted","Data":"eb57ab76d0fbacafdaf878d041f44cc4803b6259e4044cacca92e145ae723d17"}
Jul 06 03:15:33.732405 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.732060    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" event={"ID":"439525b5-9873-4005-979e-acad5f0c2a16","Type":"ContainerStarted","Data":"5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb"}
Jul 06 03:15:33.732405 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.732228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:33.749907 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:33.749850    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" podStartSLOduration=1.379244431 podStartE2EDuration="1.749834496s" totalImagesPullingTime="370.590065ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:15:33.748015592 +0000 UTC m=+2168.099217890" watchObservedRunningTime="2026-07-06 03:15:33.749834496 +0000 UTC m=+2168.101036795"
Jul 06 03:15:39.743098 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:39.743069    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:44.802336 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.802312    2557 generic.go:356] "Generic (PLEG): container finished" podID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerID="7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b" exitCode=0
Jul 06 03:15:44.802686 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.802356    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerDied","Data":"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"}
Jul 06 03:15:44.802799 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.802776    2557 scope.go:117] "RemoveContainer" containerID="7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"
Jul 06 03:15:44.803816 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.803789    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:44.803938 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.803877    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:44.803938 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:44.803925    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:15:45.809765 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:45.809730    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerStarted","Data":"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"}
Jul 06 03:15:45.977639 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:45.977603    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:45.977919 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:45.977816    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" podUID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" containerName="maas-api" containerID="cri-o://431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2" gracePeriod=30
Jul 06 03:15:46.213201 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.213167    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:46.213959 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.213934    2557 patch_prober.go:28] interesting pod/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 03:15:46.214088 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.213984    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 03:15:46.279982 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.279955    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:46.307993 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.307961    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") pod \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") "
Jul 06 03:15:46.308163 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.308103    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxcf5\" (UniqueName: \"kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5\") pod \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") "
Jul 06 03:15:46.308236 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.308196    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca\") pod \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\" (UID: \"d2ad47c0-09dd-4edd-b839-0ba194e1793a\") "
Jul 06 03:15:46.308641 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.308597    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2ad47c0-09dd-4edd-b839-0ba194e1793a" (UID: "d2ad47c0-09dd-4edd-b839-0ba194e1793a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:15:46.310370 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.310343    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2ad47c0-09dd-4edd-b839-0ba194e1793a" (UID: "d2ad47c0-09dd-4edd-b839-0ba194e1793a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:15:46.310759 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.310736    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5" (OuterVolumeSpecName: "kube-api-access-lxcf5") pod "d2ad47c0-09dd-4edd-b839-0ba194e1793a" (UID: "d2ad47c0-09dd-4edd-b839-0ba194e1793a"). InnerVolumeSpecName "kube-api-access-lxcf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:15:46.416429 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.410982    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ad47c0-09dd-4edd-b839-0ba194e1793a-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:46.416429 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.411021    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ad47c0-09dd-4edd-b839-0ba194e1793a-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:46.416429 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.411043    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxcf5\" (UniqueName: \"kubernetes.io/projected/d2ad47c0-09dd-4edd-b839-0ba194e1793a-kube-api-access-lxcf5\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:46.720413 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.720386    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:46.816328 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.816296    2557 generic.go:356] "Generic (PLEG): container finished" podID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" containerID="431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2" exitCode=0
Jul 06 03:15:46.816809 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.816357    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"
Jul 06 03:15:46.816809 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.816376    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" event={"ID":"d2ad47c0-09dd-4edd-b839-0ba194e1793a","Type":"ContainerDied","Data":"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"}
Jul 06 03:15:46.816809 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.816426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs" event={"ID":"d2ad47c0-09dd-4edd-b839-0ba194e1793a","Type":"ContainerDied","Data":"0f20a934dbf395e739d81c7c44bf12b0fb6250154fe895f09a0aa6b026a05e9d"}
Jul 06 03:15:46.816809 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.816449    2557 scope.go:117] "RemoveContainer" containerID="431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"
Jul 06 03:15:46.826732 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.826717    2557 scope.go:117] "RemoveContainer" containerID="431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"
Jul 06 03:15:46.826989 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:15:46.826972    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2\": container with ID starting with 431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2 not found: ID does not exist" containerID="431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"
Jul 06 03:15:46.827036 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.826999    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2"} err="failed to get container status \"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2\": rpc error: code = NotFound desc = could not find container \"431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2\": container with ID starting with 431fc2068870f0ac221ad1480c4f455592bb4fc6db98f2a9f219c7c21238d6e2 not found: ID does not exist"
Jul 06 03:15:46.837423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.837401    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:46.839411 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:46.839391    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a20636-5b7997f59d-t27zs"]
Jul 06 03:15:47.213830 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:47.213793    2557 patch_prober.go:28] interesting pod/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 03:15:47.214097 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:47.213864    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 03:15:48.214361 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:48.214317    2557 patch_prober.go:28] interesting pod/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 03:15:48.214864 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:48.214383    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 03:15:48.230977 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:48.230947    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" path="/var/lib/kubelet/pods/d2ad47c0-09dd-4edd-b839-0ba194e1793a/volumes"
Jul 06 03:15:49.213789 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:49.213758    2557 patch_prober.go:28] interesting pod/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 06 03:15:49.213958 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:49.213816    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 06 03:15:50.217692 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:50.217665    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:50.218557 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:50.218537    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:15:52.610560 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.610517    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:52.610986 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.610766    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" podUID="439525b5-9873-4005-979e-acad5f0c2a16" containerName="maas-api" containerID="cri-o://eb57ab76d0fbacafdaf878d041f44cc4803b6259e4044cacca92e145ae723d17" gracePeriod=30
Jul 06 03:15:52.849969 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.849942    2557 generic.go:356] "Generic (PLEG): container finished" podID="439525b5-9873-4005-979e-acad5f0c2a16" containerID="eb57ab76d0fbacafdaf878d041f44cc4803b6259e4044cacca92e145ae723d17" exitCode=0
Jul 06 03:15:52.850089 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.849975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" event={"ID":"439525b5-9873-4005-979e-acad5f0c2a16","Type":"ContainerDied","Data":"eb57ab76d0fbacafdaf878d041f44cc4803b6259e4044cacca92e145ae723d17"}
Jul 06 03:15:52.850089 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.850028    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl" event={"ID":"439525b5-9873-4005-979e-acad5f0c2a16","Type":"ContainerDied","Data":"5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb"}
Jul 06 03:15:52.850089 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.850044    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a3badc85b6a8e3f61cf51374dacb439b393388af49b6bc78e4e85f4d88dfbbb"
Jul 06 03:15:52.860306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.860286    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:52.978890 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.978871    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca\") pod \"439525b5-9873-4005-979e-acad5f0c2a16\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") "
Jul 06 03:15:52.979027 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.978898    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls\") pod \"439525b5-9873-4005-979e-acad5f0c2a16\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") "
Jul 06 03:15:52.979027 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.978950    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz9sb\" (UniqueName: \"kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb\") pod \"439525b5-9873-4005-979e-acad5f0c2a16\" (UID: \"439525b5-9873-4005-979e-acad5f0c2a16\") "
Jul 06 03:15:52.979281 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.979257    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "439525b5-9873-4005-979e-acad5f0c2a16" (UID: "439525b5-9873-4005-979e-acad5f0c2a16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:15:52.981103 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.981082    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "439525b5-9873-4005-979e-acad5f0c2a16" (UID: "439525b5-9873-4005-979e-acad5f0c2a16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:15:52.981280 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:52.981260    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb" (OuterVolumeSpecName: "kube-api-access-vz9sb") pod "439525b5-9873-4005-979e-acad5f0c2a16" (UID: "439525b5-9873-4005-979e-acad5f0c2a16"). InnerVolumeSpecName "kube-api-access-vz9sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:15:53.080306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.080283    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/439525b5-9873-4005-979e-acad5f0c2a16-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:53.080306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.080305    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/439525b5-9873-4005-979e-acad5f0c2a16-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:53.080441 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.080314    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz9sb\" (UniqueName: \"kubernetes.io/projected/439525b5-9873-4005-979e-acad5f0c2a16-kube-api-access-vz9sb\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:15:53.854562 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.854532    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"
Jul 06 03:15:53.875593 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.875567    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:53.879111 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:53.879090    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-e0113f-7746c47565-rpzpl"]
Jul 06 03:15:54.230238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:54.230205    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="439525b5-9873-4005-979e-acad5f0c2a16" path="/var/lib/kubelet/pods/439525b5-9873-4005-979e-acad5f0c2a16/volumes"
Jul 06 03:15:58.326586 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:58.326553    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:15:58.326992 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:15:58.326763    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy" containerID="cri-o://03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2" gracePeriod=30
Jul 06 03:16:02.134168 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134137    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:16:02.134639 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134621    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" containerName="maas-api"
Jul 06 03:16:02.134639 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134639    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" containerName="maas-api"
Jul 06 03:16:02.134767 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134669    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439525b5-9873-4005-979e-acad5f0c2a16" containerName="maas-api"
Jul 06 03:16:02.134767 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134675    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="439525b5-9873-4005-979e-acad5f0c2a16" containerName="maas-api"
Jul 06 03:16:02.134767 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134748    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="439525b5-9873-4005-979e-acad5f0c2a16" containerName="maas-api"
Jul 06 03:16:02.134767 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.134757    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ad47c0-09dd-4edd-b839-0ba194e1793a" containerName="maas-api"
Jul 06 03:16:02.137840 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.137819    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.140582 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.140557    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-8edd65-serving-cert\""
Jul 06 03:16:02.154354 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.154329    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:16:02.266325 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.266291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lfqd\" (UniqueName: \"kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.266508 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.266355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.266508 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.266414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.367766 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.367736    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lfqd\" (UniqueName: \"kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.367973 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.367812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.367973 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.367865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.368549 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.368528    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.370206 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.370186    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.377637 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.377617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lfqd\" (UniqueName: \"kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd\") pod \"maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") " pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.451503 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.451459    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:02.589384 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.589357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:16:02.591520 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:16:02.591462    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8c733e_ddef_4eeb_9551_def13746c94a.slice/crio-383a53491cf7f32fbc95210c4e9002581d256071b97a713ad6938bfce378b529 WatchSource:0}: Error finding container 383a53491cf7f32fbc95210c4e9002581d256071b97a713ad6938bfce378b529: Status 404 returned error can't find the container with id 383a53491cf7f32fbc95210c4e9002581d256071b97a713ad6938bfce378b529
Jul 06 03:16:02.903241 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:02.903165    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" event={"ID":"1c8c733e-ddef-4eeb-9551-def13746c94a","Type":"ContainerStarted","Data":"383a53491cf7f32fbc95210c4e9002581d256071b97a713ad6938bfce378b529"}
Jul 06 03:16:03.580210 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.580187    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:16:03.679997 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.679921    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.679997 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.679967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680010    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6cfk\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680063    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680094    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680185 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680139    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680237    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680273    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket\") pod \"4c367ffc-61cc-48be-861d-32f90ede45b1\" (UID: \"4c367ffc-61cc-48be-861d-32f90ede45b1\") "
Jul 06 03:16:03.680394 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680330    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:16:03.680647 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680599    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:16:03.680724 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680703    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.680786 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680725    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c367ffc-61cc-48be-861d-32f90ede45b1-istiod-ca-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.680846 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680738    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:16:03.680846 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.680817    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:16:03.681359 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.681331    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:16:03.682311 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.682286    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk" (OuterVolumeSpecName: "kube-api-access-q6cfk") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "kube-api-access-q6cfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:16:03.682423 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.682321    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:16:03.682495 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.682459    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 03:16:03.682567 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.682545    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c367ffc-61cc-48be-861d-32f90ede45b1" (UID: "4c367ffc-61cc-48be-861d-32f90ede45b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:16:03.781637 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781616    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-credential-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781637 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781636    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-envoy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781646    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6cfk\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-kube-api-access-q6cfk\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781654    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-podinfo\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781663    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-workload-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781670    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-data\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.781780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.781680    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c367ffc-61cc-48be-861d-32f90ede45b1-istio-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:16:03.909529 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.909493    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" event={"ID":"1c8c733e-ddef-4eeb-9551-def13746c94a","Type":"ContainerStarted","Data":"feb6c03c919688e001ac47d83bb8832043fb73cc906e438603dce38b25d9177e"}
Jul 06 03:16:03.909679 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.909593    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:03.911143 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.911119    2557 generic.go:356] "Generic (PLEG): container finished" podID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerID="03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2" exitCode=0
Jul 06 03:16:03.911246 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.911171    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"
Jul 06 03:16:03.911246 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.911181    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerDied","Data":"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"}
Jul 06 03:16:03.911246 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.911226    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7" event={"ID":"4c367ffc-61cc-48be-861d-32f90ede45b1","Type":"ContainerDied","Data":"b0ccd791ebde240a5efb3be2db7713a4271c974f31fda5e4adc574a700f28b03"}
Jul 06 03:16:03.911411 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.911255    2557 scope.go:117] "RemoveContainer" containerID="03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"
Jul 06 03:16:03.921362 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.921345    2557 scope.go:117] "RemoveContainer" containerID="7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"
Jul 06 03:16:03.927257 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.927218    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" podStartSLOduration=1.600904668 podStartE2EDuration="1.927205368s" totalImagesPullingTime="326.3007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:16:03.925703799 +0000 UTC m=+2198.276906116" watchObservedRunningTime="2026-07-06 03:16:03.927205368 +0000 UTC m=+2198.278407663"
Jul 06 03:16:03.929732 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.929712    2557 scope.go:117] "RemoveContainer" containerID="03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"
Jul 06 03:16:03.929976 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:16:03.929958    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2\": container with ID starting with 03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2 not found: ID does not exist" containerID="03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"
Jul 06 03:16:03.930056 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.929984    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2"} err="failed to get container status \"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2\": rpc error: code = NotFound desc = could not find container \"03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2\": container with ID starting with 03ffb7b0882b301286ec48e533dd6242dd4ffdff15f36b74f26eb39763256dc2 not found: ID does not exist"
Jul 06 03:16:03.930056 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.929998    2557 scope.go:117] "RemoveContainer" containerID="7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"
Jul 06 03:16:03.930229 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:16:03.930211    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b\": container with ID starting with 7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b not found: ID does not exist" containerID="7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"
Jul 06 03:16:03.930273 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.930236    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b"} err="failed to get container status \"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b\": rpc error: code = NotFound desc = could not find container \"7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b\": container with ID starting with 7d4f472bc147e08a4d7558bfdcfd25b200221255fc802ce1da49094abfeda46b not found: ID does not exist"
Jul 06 03:16:03.942277 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.942254    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:16:03.945922 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:03.945901    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e0113f-openshift-default-7d8df9bb69-wfwb7"]
Jul 06 03:16:04.230674 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:04.230645    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" path="/var/lib/kubelet/pods/4c367ffc-61cc-48be-861d-32f90ede45b1/volumes"
Jul 06 03:16:07.034613 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.034581    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:16:07.035245 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.035227    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:07.035245 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.035246    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:07.035368 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.035258    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:07.035368 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.035266    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:07.035368 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.035352    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:07.040203 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.040181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.042591 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.042571    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5fe2d5-openshift-default-dockercfg-qpg4k\""
Jul 06 03:16:07.051016 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.050982    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:16:07.215152 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215326 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215326 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215326 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsz9t\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215492 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215492 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215398    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215492 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215657 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.215657 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.215606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316203 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316203 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316203 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316196    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsz9t\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316354    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316506 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316825 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316802    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316883 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316807    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316883 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316809    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316973 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316890    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.316973 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.316909    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.318763 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.318742    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.318985 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.318968    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.325622 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.325600    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.326221 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.326204    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsz9t\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t\") pod \"e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") " pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.351895 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.351864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:07.494092 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.494061    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:16:07.495629 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:16:07.495603    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc818bb7_f4aa_441d_895f_d024b533e387.slice/crio-b17632a85ab3665a0d4096585f76f1a15f719a43fb1634c43e203b12ab07d942 WatchSource:0}: Error finding container b17632a85ab3665a0d4096585f76f1a15f719a43fb1634c43e203b12ab07d942: Status 404 returned error can't find the container with id b17632a85ab3665a0d4096585f76f1a15f719a43fb1634c43e203b12ab07d942
Jul 06 03:16:07.497895 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.497862    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:07.497980 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.497929    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:07.497980 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.497958    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:07.936001 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.935952    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerStarted","Data":"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"}
Jul 06 03:16:07.936189 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.936018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerStarted","Data":"b17632a85ab3665a0d4096585f76f1a15f719a43fb1634c43e203b12ab07d942"}
Jul 06 03:16:07.960651 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:07.960603    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podStartSLOduration=0.960588449 podStartE2EDuration="960.588449ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:16:07.958047235 +0000 UTC m=+2202.309249541" watchObservedRunningTime="2026-07-06 03:16:07.960588449 +0000 UTC m=+2202.311790745"
Jul 06 03:16:08.352759 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:08.352734    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:08.357812 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:08.357788    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:08.941059 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:08.941020    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:08.941929 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:08.941905    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:09.923699 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:09.923672    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:16:10.031864 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.031822    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:16:10.032368 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.032351    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c367ffc-61cc-48be-861d-32f90ede45b1" containerName="istio-proxy"
Jul 06 03:16:10.035677 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.035657    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.038306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.038283    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-5fe2d5-serving-cert\""
Jul 06 03:16:10.048318 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.048294    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:16:10.143859 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.143819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r746\" (UniqueName: \"kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.144041 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.143963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.144041 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.144008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.244949 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.244910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.245128 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.244958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.245128 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.245027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r746\" (UniqueName: \"kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.245647 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.245625    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.247445 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.247416    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.252454 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.252431    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r746\" (UniqueName: \"kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746\") pod \"maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") " pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.349400 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.349372    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.491398 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.491370    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:16:10.493156 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:16:10.493127    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7366be1_9b52_4889_ad36_081eadc9ebee.slice/crio-a7276ca69675e984b6fc08c71ef4cc9433b7848e8f8a0548ca5db8af38988f5a WatchSource:0}: Error finding container a7276ca69675e984b6fc08c71ef4cc9433b7848e8f8a0548ca5db8af38988f5a: Status 404 returned error can't find the container with id a7276ca69675e984b6fc08c71ef4cc9433b7848e8f8a0548ca5db8af38988f5a
Jul 06 03:16:10.953740 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.953708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" event={"ID":"f7366be1-9b52-4889-ad36-081eadc9ebee","Type":"ContainerStarted","Data":"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"}
Jul 06 03:16:10.954149 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.953765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" event={"ID":"f7366be1-9b52-4889-ad36-081eadc9ebee","Type":"ContainerStarted","Data":"a7276ca69675e984b6fc08c71ef4cc9433b7848e8f8a0548ca5db8af38988f5a"}
Jul 06 03:16:10.954149 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.953922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:10.969538 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:10.969498    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" podStartSLOduration=0.693497346 podStartE2EDuration="969.458645ms" totalImagesPullingTime="275.961299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 03:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:16:10.968667561 +0000 UTC m=+2205.319869883" watchObservedRunningTime="2026-07-06 03:16:10.969458645 +0000 UTC m=+2205.320660940"
Jul 06 03:16:16.964606 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:16.964574    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:16:24.982641 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:24.982603    2557 patch_prober.go:28] interesting pod/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 03:16:24.983041 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:24.982666    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 03:16:26.035304 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.035276    2557 generic.go:356] "Generic (PLEG): container finished" podID="fc818bb7-f4aa-441d-895f-d024b533e387" containerID="d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce" exitCode=0
Jul 06 03:16:26.035763 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.035349    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerDied","Data":"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"}
Jul 06 03:16:26.035918 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.035901    2557 scope.go:117] "RemoveContainer" containerID="d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"
Jul 06 03:16:26.036970 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.036940    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:26.037054 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.037037    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:26.037180 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:26.037092    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 03:16:27.042447 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:27.042412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerStarted","Data":"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"}
Jul 06 03:16:27.352558 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:27.352447    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:27.352739 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:27.352586    2557 patch_prober.go:28] interesting pod/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 03:16:27.352739 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:27.352650    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 03:16:28.352494 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:28.352437    2557 patch_prober.go:28] interesting pod/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 03:16:28.352985 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:28.352516    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 03:16:29.352545 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:29.352508    2557 patch_prober.go:28] interesting pod/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 03:16:29.353140 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:29.353107    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 03:16:30.352618 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:30.352581    2557 patch_prober.go:28] interesting pod/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 03:16:30.353227 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:30.353194    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 03:16:31.355436 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:31.355406    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:31.355805 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:31.355761    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:16:31.356356 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:16:31.356340    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:19:26.346092 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:19:26.346057    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:19:26.355353 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:19:26.355330    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:21:43.505910 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.505866    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:21:43.508021 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.506139    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" podUID="1c8c733e-ddef-4eeb-9551-def13746c94a" containerName="maas-api" containerID="cri-o://feb6c03c919688e001ac47d83bb8832043fb73cc906e438603dce38b25d9177e" gracePeriod=30
Jul 06 03:21:43.728308 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.728272    2557 generic.go:356] "Generic (PLEG): container finished" podID="1c8c733e-ddef-4eeb-9551-def13746c94a" containerID="feb6c03c919688e001ac47d83bb8832043fb73cc906e438603dce38b25d9177e" exitCode=0
Jul 06 03:21:43.728462 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.728341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" event={"ID":"1c8c733e-ddef-4eeb-9551-def13746c94a","Type":"ContainerDied","Data":"feb6c03c919688e001ac47d83bb8832043fb73cc906e438603dce38b25d9177e"}
Jul 06 03:21:43.759052 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.759000    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:21:43.794780 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.794747    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls\") pod \"1c8c733e-ddef-4eeb-9551-def13746c94a\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") "
Jul 06 03:21:43.794889 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.794817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca\") pod \"1c8c733e-ddef-4eeb-9551-def13746c94a\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") "
Jul 06 03:21:43.794932 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.794903    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lfqd\" (UniqueName: \"kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd\") pod \"1c8c733e-ddef-4eeb-9551-def13746c94a\" (UID: \"1c8c733e-ddef-4eeb-9551-def13746c94a\") "
Jul 06 03:21:43.795197 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.795153    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c8c733e-ddef-4eeb-9551-def13746c94a" (UID: "1c8c733e-ddef-4eeb-9551-def13746c94a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:21:43.795306 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.795236    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c8c733e-ddef-4eeb-9551-def13746c94a-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:21:43.796916 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.796887    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd" (OuterVolumeSpecName: "kube-api-access-4lfqd") pod "1c8c733e-ddef-4eeb-9551-def13746c94a" (UID: "1c8c733e-ddef-4eeb-9551-def13746c94a"). InnerVolumeSpecName "kube-api-access-4lfqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:21:43.796997 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.796927    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c8c733e-ddef-4eeb-9551-def13746c94a" (UID: "1c8c733e-ddef-4eeb-9551-def13746c94a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:21:43.895781 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.895759    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c8c733e-ddef-4eeb-9551-def13746c94a-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:21:43.895781 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:43.895780    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lfqd\" (UniqueName: \"kubernetes.io/projected/1c8c733e-ddef-4eeb-9551-def13746c94a-kube-api-access-4lfqd\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:21:44.735643 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:44.735617    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"
Jul 06 03:21:44.736046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:44.735616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc" event={"ID":"1c8c733e-ddef-4eeb-9551-def13746c94a","Type":"ContainerDied","Data":"383a53491cf7f32fbc95210c4e9002581d256071b97a713ad6938bfce378b529"}
Jul 06 03:21:44.736046 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:44.735750    2557 scope.go:117] "RemoveContainer" containerID="feb6c03c919688e001ac47d83bb8832043fb73cc906e438603dce38b25d9177e"
Jul 06 03:21:44.751097 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:44.751073    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:21:44.754640 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:44.754620    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-8edd65-7756df9d8c-d54nc"]
Jul 06 03:21:46.230297 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:21:46.230266    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8c733e-ddef-4eeb-9551-def13746c94a" path="/var/lib/kubelet/pods/1c8c733e-ddef-4eeb-9551-def13746c94a/volumes"
Jul 06 03:22:26.431143 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.431109    2557 scope.go:117] "RemoveContainer" containerID="eb57ab76d0fbacafdaf878d041f44cc4803b6259e4044cacca92e145ae723d17"
Jul 06 03:22:26.603772 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.603733    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:22:26.604067 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.604008    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" podUID="f7366be1-9b52-4889-ad36-081eadc9ebee" containerName="maas-api" containerID="cri-o://87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc" gracePeriod=30
Jul 06 03:22:26.859879 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.859852    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:22:26.884197 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.884172    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r746\" (UniqueName: \"kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746\") pod \"f7366be1-9b52-4889-ad36-081eadc9ebee\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") "
Jul 06 03:22:26.884353 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.884241    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca\") pod \"f7366be1-9b52-4889-ad36-081eadc9ebee\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") "
Jul 06 03:22:26.884353 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.884331    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls\") pod \"f7366be1-9b52-4889-ad36-081eadc9ebee\" (UID: \"f7366be1-9b52-4889-ad36-081eadc9ebee\") "
Jul 06 03:22:26.884829 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.884802    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f7366be1-9b52-4889-ad36-081eadc9ebee" (UID: "f7366be1-9b52-4889-ad36-081eadc9ebee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:22:26.886418 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.886389    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746" (OuterVolumeSpecName: "kube-api-access-6r746") pod "f7366be1-9b52-4889-ad36-081eadc9ebee" (UID: "f7366be1-9b52-4889-ad36-081eadc9ebee"). InnerVolumeSpecName "kube-api-access-6r746". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:22:26.886563 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.886541    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f7366be1-9b52-4889-ad36-081eadc9ebee" (UID: "f7366be1-9b52-4889-ad36-081eadc9ebee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 03:22:26.952307 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.952280    2557 generic.go:356] "Generic (PLEG): container finished" podID="f7366be1-9b52-4889-ad36-081eadc9ebee" containerID="87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc" exitCode=0
Jul 06 03:22:26.952426 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.952323    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"
Jul 06 03:22:26.952426 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.952327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" event={"ID":"f7366be1-9b52-4889-ad36-081eadc9ebee","Type":"ContainerDied","Data":"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"}
Jul 06 03:22:26.952426 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.952424    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk" event={"ID":"f7366be1-9b52-4889-ad36-081eadc9ebee","Type":"ContainerDied","Data":"a7276ca69675e984b6fc08c71ef4cc9433b7848e8f8a0548ca5db8af38988f5a"}
Jul 06 03:22:26.952563 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.952446    2557 scope.go:117] "RemoveContainer" containerID="87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"
Jul 06 03:22:26.962019 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.962003    2557 scope.go:117] "RemoveContainer" containerID="87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"
Jul 06 03:22:26.962266 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:22:26.962245    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc\": container with ID starting with 87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc not found: ID does not exist" containerID="87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"
Jul 06 03:22:26.962333 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.962273    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc"} err="failed to get container status \"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc\": rpc error: code = NotFound desc = could not find container \"87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc\": container with ID starting with 87dfbe1968ced6f281cc4063889b5e46111af116d4da9601585cd235579708bc not found: ID does not exist"
Jul 06 03:22:26.974245 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.974184    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:22:26.980096 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.980076    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-5fe2d5-755d858f6f-gr9dk"]
Jul 06 03:22:26.985158 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.985138    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7366be1-9b52-4889-ad36-081eadc9ebee-openshift-service-ca\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:26.985239 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.985159    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f7366be1-9b52-4889-ad36-081eadc9ebee-maas-api-tls\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:26.985239 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:26.985172    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r746\" (UniqueName: \"kubernetes.io/projected/f7366be1-9b52-4889-ad36-081eadc9ebee-kube-api-access-6r746\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:28.231054 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:28.231018    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7366be1-9b52-4889-ad36-081eadc9ebee" path="/var/lib/kubelet/pods/f7366be1-9b52-4889-ad36-081eadc9ebee/volumes"
Jul 06 03:22:32.234210 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:32.234176    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:22:32.234693 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:32.234433    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy" containerID="cri-o://c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f" gracePeriod=30
Jul 06 03:22:37.494772 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.494747    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:22:37.505407 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.505337    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mh5n5_7743ee66-c11d-4c09-ba3f-b7d25482ebf8/manager/0.log"
Jul 06 03:22:37.586830 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586809    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586861    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsz9t\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586880    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586917    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586939    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586954    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.586995 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.586969    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.587364 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587011    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.587364 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587312    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:22:37.587364 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587322    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:22:37.587546 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587433    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket\") pod \"fc818bb7-f4aa-441d-895f-d024b533e387\" (UID: \"fc818bb7-f4aa-441d-895f-d024b533e387\") "
Jul 06 03:22:37.587546 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587462    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 03:22:37.587672 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587653    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:22:37.587805 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587790    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc818bb7-f4aa-441d-895f-d024b533e387-istiod-ca-cert\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.587887 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587807    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-certs\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.587887 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587830    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-credential-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.587887 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.587839    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-workload-socket\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.588211 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.588183    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:22:37.589263 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.589233    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:22:37.589361 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.589333    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 03:22:37.589580 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.589561    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t" (OuterVolumeSpecName: "kube-api-access-lsz9t") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "kube-api-access-lsz9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 03:22:37.589638 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.589587    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc818bb7-f4aa-441d-895f-d024b533e387" (UID: "fc818bb7-f4aa-441d-895f-d024b533e387"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 03:22:37.688600 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.688578    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsz9t\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-kube-api-access-lsz9t\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.688600 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.688599    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-data\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.688749 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.688608    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc818bb7-f4aa-441d-895f-d024b533e387-istio-envoy\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.688749 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.688618    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc818bb7-f4aa-441d-895f-d024b533e387-istio-podinfo\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.688749 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.688626    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc818bb7-f4aa-441d-895f-d024b533e387-istio-token\") on node \"ip-10-0-139-33.ec2.internal\" DevicePath \"\""
Jul 06 03:22:37.779643 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:37.779580    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f9c958f9-j2wdm_e3245278-ed57-4a81-a52d-020a1cda37af/maas-api/0.log"
Jul 06 03:22:38.011735 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.011703    2557 generic.go:356] "Generic (PLEG): container finished" podID="fc818bb7-f4aa-441d-895f-d024b533e387" containerID="c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f" exitCode=0
Jul 06 03:22:38.011904 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.011752    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"
Jul 06 03:22:38.011904 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.011789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerDied","Data":"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"}
Jul 06 03:22:38.011904 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.011855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww" event={"ID":"fc818bb7-f4aa-441d-895f-d024b533e387","Type":"ContainerDied","Data":"b17632a85ab3665a0d4096585f76f1a15f719a43fb1634c43e203b12ab07d942"}
Jul 06 03:22:38.011904 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.011881    2557 scope.go:117] "RemoveContainer" containerID="c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"
Jul 06 03:22:38.021933 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.021916    2557 scope.go:117] "RemoveContainer" containerID="d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"
Jul 06 03:22:38.029835 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.029817    2557 scope.go:117] "RemoveContainer" containerID="c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"
Jul 06 03:22:38.030083 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:22:38.030066    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f\": container with ID starting with c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f not found: ID does not exist" containerID="c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"
Jul 06 03:22:38.030132 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.030091    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f"} err="failed to get container status \"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f\": rpc error: code = NotFound desc = could not find container \"c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f\": container with ID starting with c7253139f1fd7c4d3ea09bc569cb3e584a2ba669aaff3a7c476cb75923d7498f not found: ID does not exist"
Jul 06 03:22:38.030132 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.030113    2557 scope.go:117] "RemoveContainer" containerID="d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"
Jul 06 03:22:38.030522 ip-10-0-139-33 kubenswrapper[2557]: E0706 03:22:38.030498    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce\": container with ID starting with d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce not found: ID does not exist" containerID="d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"
Jul 06 03:22:38.030596 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.030526    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce"} err="failed to get container status \"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce\": rpc error: code = NotFound desc = could not find container \"d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce\": container with ID starting with d14d561ee29a2e941efc9830cead6acf34390fadcad6a1e8c595def962fe3fce not found: ID does not exist"
Jul 06 03:22:38.036223 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.036203    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:22:38.039966 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.039948    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5fe2d5-openshift-default-7dd8b9f9ff-fnqww"]
Jul 06 03:22:38.127812 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.127788    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d64479c74-ls9k5_d497c03b-4fa8-4b71-9bd8-5cef7a61909c/manager/0.log"
Jul 06 03:22:38.231173 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.231152    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" path="/var/lib/kubelet/pods/fc818bb7-f4aa-441d-895f-d024b533e387/volumes"
Jul 06 03:22:38.726173 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.726127    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-xfgqr_37e34e97-a971-4ac6-a626-2b71ecea44c7/manager/0.log"
Jul 06 03:22:38.733197 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.733175    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-xfgqr_37e34e97-a971-4ac6-a626-2b71ecea44c7/copy-manifests/0.log"
Jul 06 03:22:38.846731 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:38.846711    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tjqrp_9921f7eb-b6dd-4300-bf25-ba7f289d1dd0/postgres/0.log"
Jul 06 03:22:40.347521 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:40.347484    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wpxhw_ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a/manager/0.log"
Jul 06 03:22:40.598218 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:40.598105    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lhn5f_128adbf2-4dbd-4592-95c1-3f3e52e600b7/registry-server/0.log"
Jul 06 03:22:40.969288 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:40.969254    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-88rnd_74c5fc1f-4930-47d0-b184-5f9421367af2/manager/0.log"
Jul 06 03:22:41.326933 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:41.326846    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dsvwz_493e0399-4083-456e-a27e-f466721d2ace/istio-proxy/0.log"
Jul 06 03:22:41.810370 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:41.810339    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/1.log"
Jul 06 03:22:41.930637 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:41.930611    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qcrx8_185ecd0e-545e-4a3b-85d1-b08db725c6c5/payload-pre-processing/0.log"
Jul 06 03:22:42.525291 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:42.525260    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6slml_82687ee8-03f5-4445-9b8d-459b338d9acf/main/0.log"
Jul 06 03:22:42.642438 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:42.642403    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mcrhb_7f9e762f-c748-4534-b47b-d08bc23ad468/main/0.log"
Jul 06 03:22:42.995976 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:42.995930    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-h457c_4c580366-4dbb-4e99-a9cf-246e64848d68/main/0.log"
Jul 06 03:22:50.130567 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:50.130494    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tctwn_dc5bd342-a2f7-4a82-9c47-92d06fd63a16/global-pull-secret-syncer/0.log"
Jul 06 03:22:50.257894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:50.257859    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pgsjn_767ebcbc-221d-4250-973e-f659627967dc/konnectivity-agent/0.log"
Jul 06 03:22:50.361092 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:50.361036    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-33.ec2.internal_5adcc9393bdc45ff5e4e17d808ba5066/haproxy/0.log"
Jul 06 03:22:55.307645 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:55.307612    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wpxhw_ef08fe57-ac7e-46b2-a24a-c7390cdc1b2a/manager/0.log"
Jul 06 03:22:55.378672 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:55.378592    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lhn5f_128adbf2-4dbd-4592-95c1-3f3e52e600b7/registry-server/0.log"
Jul 06 03:22:55.664738 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:55.664637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-88rnd_74c5fc1f-4930-47d0-b184-5f9421367af2/manager/0.log"
Jul 06 03:22:57.293206 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.293125    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/alertmanager/0.log"
Jul 06 03:22:57.323088 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.323062    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/config-reloader/0.log"
Jul 06 03:22:57.357601 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.357572    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/kube-rbac-proxy-web/0.log"
Jul 06 03:22:57.386603 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.386565    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/kube-rbac-proxy/0.log"
Jul 06 03:22:57.409465 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.409444    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/kube-rbac-proxy-metric/0.log"
Jul 06 03:22:57.437168 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.437147    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/prom-label-proxy/0.log"
Jul 06 03:22:57.456862 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.456832    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54ee2462-13e4-48ac-bdee-11d3eeb2cbef/init-config-reloader/0.log"
Jul 06 03:22:57.613069 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.612982    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d7f67c9cf-88kjk_2f78d386-b986-4884-8147-80215e6342b7/metrics-server/0.log"
Jul 06 03:22:57.851375 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.851347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdmt4_7c2b83ac-4b51-44aa-9c92-ee85bbb102af/node-exporter/0.log"
Jul 06 03:22:57.870889 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.870802    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdmt4_7c2b83ac-4b51-44aa-9c92-ee85bbb102af/kube-rbac-proxy/0.log"
Jul 06 03:22:57.892714 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.892688    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdmt4_7c2b83ac-4b51-44aa-9c92-ee85bbb102af/init-textfile/0.log"
Jul 06 03:22:57.919594 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.919563    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rrcp_f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d/kube-rbac-proxy-main/0.log"
Jul 06 03:22:57.940687 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.940652    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rrcp_f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d/kube-rbac-proxy-self/0.log"
Jul 06 03:22:57.965808 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:57.965781    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5rrcp_f088748c-8fd2-4aa9-ad7d-b1c1c6ee995d/openshift-state-metrics/0.log"
Jul 06 03:22:58.003157 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.003125    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/prometheus/0.log"
Jul 06 03:22:58.023544 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.023495    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/config-reloader/0.log"
Jul 06 03:22:58.046747 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.046718    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/thanos-sidecar/0.log"
Jul 06 03:22:58.066597 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.066570    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/kube-rbac-proxy-web/0.log"
Jul 06 03:22:58.087125 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.087096    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/kube-rbac-proxy/0.log"
Jul 06 03:22:58.108894 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.108865    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/kube-rbac-proxy-thanos/0.log"
Jul 06 03:22:58.129252 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.129167    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5c2b119-fcf7-41a2-b405-e0c3296fd7d7/init-config-reloader/0.log"
Jul 06 03:22:58.172798 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.172767    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-h86lk_d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9/prometheus-operator/0.log"
Jul 06 03:22:58.191650 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:22:58.191627    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-h86lk_d7b6e7a4-fafd-4af8-ad62-718d3f1b80b9/kube-rbac-proxy/0.log"
Jul 06 03:23:00.169623 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.169591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/1.log"
Jul 06 03:23:00.179950 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.179928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-q5v77_9d48f2a6-b09e-4246-9603-7f558661ea10/console-operator/2.log"
Jul 06 03:23:00.470595 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.470554    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"]
Jul 06 03:23:00.471120 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471099    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471123    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471156    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8c733e-ddef-4eeb-9551-def13746c94a" containerName="maas-api"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471164    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8c733e-ddef-4eeb-9551-def13746c94a" containerName="maas-api"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471175    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471184    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471208    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7366be1-9b52-4889-ad36-081eadc9ebee" containerName="maas-api"
Jul 06 03:23:00.471238 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471217    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7366be1-9b52-4889-ad36-081eadc9ebee" containerName="maas-api"
Jul 06 03:23:00.471599 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471319    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8c733e-ddef-4eeb-9551-def13746c94a" containerName="maas-api"
Jul 06 03:23:00.471599 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471332    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7366be1-9b52-4889-ad36-081eadc9ebee" containerName="maas-api"
Jul 06 03:23:00.471599 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471344    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.471599 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.471353    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc818bb7-f4aa-441d-895f-d024b533e387" containerName="istio-proxy"
Jul 06 03:23:00.476267 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.476244    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.479119 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.479095    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ftgk5\"/\"kube-root-ca.crt\""
Jul 06 03:23:00.479242 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.479095    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ftgk5\"/\"default-dockercfg-lnmn7\""
Jul 06 03:23:00.479242 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.479233    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ftgk5\"/\"openshift-service-ca.crt\""
Jul 06 03:23:00.481070 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.481048    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"]
Jul 06 03:23:00.506048 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.506019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-sys\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.506048 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.506049    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-proc\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.506207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.506080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-podres\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.506207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.506129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-lib-modules\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.506207 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.506158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcts\" (UniqueName: \"kubernetes.io/projected/d210293d-dae9-4d96-947b-6006fa8bf3b3-kube-api-access-plcts\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.606791 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-sys\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.606791 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-proc\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-podres\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-lib-modules\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcts\" (UniqueName: \"kubernetes.io/projected/d210293d-dae9-4d96-947b-6006fa8bf3b3-kube-api-access-plcts\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606867    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-sys\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606895    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-proc\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606936    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-podres\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.607038 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.606973    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d210293d-dae9-4d96-947b-6006fa8bf3b3-lib-modules\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.615448 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.615408    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcts\" (UniqueName: \"kubernetes.io/projected/d210293d-dae9-4d96-947b-6006fa8bf3b3-kube-api-access-plcts\") pod \"perf-node-gather-daemonset-mf6ds\" (UID: \"d210293d-dae9-4d96-947b-6006fa8bf3b3\") " pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.778428 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.778346    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-qbh28_f0b970af-4dd5-4d2a-afdb-5f64de0e12c7/download-server/0.log"
Jul 06 03:23:00.787621 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.787599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:00.920742 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:00.920718    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"]
Jul 06 03:23:00.923139 ip-10-0-139-33 kubenswrapper[2557]: W0706 03:23:00.923116    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd210293d_dae9_4d96_947b_6006fa8bf3b3.slice/crio-24a6dbd5dff22b4788064f7a709489d7ca71ff38932cbefbf4820c02a03a59b8 WatchSource:0}: Error finding container 24a6dbd5dff22b4788064f7a709489d7ca71ff38932cbefbf4820c02a03a59b8: Status 404 returned error can't find the container with id 24a6dbd5dff22b4788064f7a709489d7ca71ff38932cbefbf4820c02a03a59b8
Jul 06 03:23:01.130535 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:01.130495    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds" event={"ID":"d210293d-dae9-4d96-947b-6006fa8bf3b3","Type":"ContainerStarted","Data":"195b10932f69d442ba5e554f7b88747e560cb46ad984e1b3457c70375d7593a7"}
Jul 06 03:23:01.130720 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:01.130650    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:01.130720 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:01.130676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds" event={"ID":"d210293d-dae9-4d96-947b-6006fa8bf3b3","Type":"ContainerStarted","Data":"24a6dbd5dff22b4788064f7a709489d7ca71ff38932cbefbf4820c02a03a59b8"}
Jul 06 03:23:01.145282 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:01.145237    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds" podStartSLOduration=1.145223229 podStartE2EDuration="1.145223229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 03:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 03:23:01.144409596 +0000 UTC m=+2615.495611892" watchObservedRunningTime="2026-07-06 03:23:01.145223229 +0000 UTC m=+2615.496425569"
Jul 06 03:23:01.383633 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:01.383554    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-v88vk_7f4e16ee-6abe-4f9f-9362-a7412754d753/volume-data-source-validator/0.log"
Jul 06 03:23:02.485802 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:02.485770    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhl65_cacbc36e-1d58-4e1b-90ba-939e741581a8/dns/0.log"
Jul 06 03:23:02.506236 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:02.506205    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lhl65_cacbc36e-1d58-4e1b-90ba-939e741581a8/kube-rbac-proxy/0.log"
Jul 06 03:23:02.551073 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:02.551045    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bnb6s_26082228-58e2-4d40-8743-07183c62fe27/dns-node-resolver/0.log"
Jul 06 03:23:03.093677 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:03.093643    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f4d5c95f8-v2t4g_1d480bd0-a7b5-44a2-904b-e245098e62eb/registry/0.log"
Jul 06 03:23:03.115493 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:03.115447    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2sx67_ea3397fd-652a-4fd4-a5b3-dc7672131a5a/node-ca/0.log"
Jul 06 03:23:04.105980 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:04.105943    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dsvwz_493e0399-4083-456e-a27e-f466721d2ace/istio-proxy/0.log"
Jul 06 03:23:04.292640 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:04.292608    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/0.log"
Jul 06 03:23:04.348492 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:04.348448    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/1.log"
Jul 06 03:23:04.387778 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:04.387698    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qcrx8_185ecd0e-545e-4a3b-85d1-b08db725c6c5/payload-pre-processing/0.log"
Jul 06 03:23:05.125299 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.125267    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24mf4_8c3a0fd9-d7f9-4412-87b9-c25ab0af03ea/serve-healthcheck-canary/0.log"
Jul 06 03:23:05.678847 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.678817    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-9dkpx_c1922c12-c653-4aa1-a60a-f317cf3e5eb6/insights-operator/0.log"
Jul 06 03:23:05.679398 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.679377    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-9dkpx_c1922c12-c653-4aa1-a60a-f317cf3e5eb6/insights-operator/1.log"
Jul 06 03:23:05.841496 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.841449    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9q5s_2bdfa3cb-4eed-4178-b060-fd58c95f1d4e/kube-rbac-proxy/0.log"
Jul 06 03:23:05.861636 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.861608    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9q5s_2bdfa3cb-4eed-4178-b060-fd58c95f1d4e/exporter/0.log"
Jul 06 03:23:05.882464 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:05.882439    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9q5s_2bdfa3cb-4eed-4178-b060-fd58c95f1d4e/extractor/0.log"
Jul 06 03:23:07.146924 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:07.146897    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ftgk5/perf-node-gather-daemonset-mf6ds"
Jul 06 03:23:08.004006 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.003973    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mh5n5_7743ee66-c11d-4c09-ba3f-b7d25482ebf8/manager/0.log"
Jul 06 03:23:08.181750 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.181697    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f9c958f9-j2wdm_e3245278-ed57-4a81-a52d-020a1cda37af/maas-api/0.log"
Jul 06 03:23:08.389262 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.389162    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d64479c74-ls9k5_d497c03b-4fa8-4b71-9bd8-5cef7a61909c/manager/0.log"
Jul 06 03:23:08.708409 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.708386    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-xfgqr_37e34e97-a971-4ac6-a626-2b71ecea44c7/manager/0.log"
Jul 06 03:23:08.731010 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.730988    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d49d64447-xfgqr_37e34e97-a971-4ac6-a626-2b71ecea44c7/copy-manifests/0.log"
Jul 06 03:23:08.756282 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:08.756259    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tjqrp_9921f7eb-b6dd-4300-bf25-ba7f289d1dd0/postgres/0.log"
Jul 06 03:23:10.256816 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:10.256785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56497ccf4b-bf26c_ba32606d-6281-48fb-bb75-8dcb0ba8538b/manager/0.log"
Jul 06 03:23:10.507236 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:10.507206    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dsvwz_493e0399-4083-456e-a27e-f466721d2ace/istio-proxy/0.log"
Jul 06 03:23:10.658393 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:10.658364    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/0.log"
Jul 06 03:23:10.713949 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:10.713921    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/1.log"
Jul 06 03:23:10.746592 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:10.746569    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qcrx8_185ecd0e-545e-4a3b-85d1-b08db725c6c5/payload-pre-processing/0.log"
Jul 06 03:23:11.925087 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:11.925058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dsvwz_493e0399-4083-456e-a27e-f466721d2ace/istio-proxy/0.log"
Jul 06 03:23:12.086570 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:12.086539    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/0.log"
Jul 06 03:23:12.142701 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:12.142673    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rzdlw_57a09d33-18f7-4149-b4d2-42934c1a53b1/istio-proxy/1.log"
Jul 06 03:23:12.174975 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:12.174952    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qcrx8_185ecd0e-545e-4a3b-85d1-b08db725c6c5/payload-pre-processing/0.log"
Jul 06 03:23:16.703985 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.703956    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/kube-multus-additional-cni-plugins/0.log"
Jul 06 03:23:16.725483 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.725459    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/egress-router-binary-copy/0.log"
Jul 06 03:23:16.753870 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.753846    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/cni-plugins/0.log"
Jul 06 03:23:16.816665 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.816643    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/bond-cni-plugin/0.log"
Jul 06 03:23:16.872024 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.871993    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/routeoverride-cni/0.log"
Jul 06 03:23:16.899076 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.899058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/whereabouts-cni-bincopy/0.log"
Jul 06 03:23:16.920109 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:16.920088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-95fkk_a7eadb9a-e575-408d-8996-4bcef2d6e3b7/whereabouts-cni/0.log"
Jul 06 03:23:17.123150 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:17.123075    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qf2dv_76e67a7e-cc97-497a-bb9b-88edbc098883/kube-multus/0.log"
Jul 06 03:23:17.173312 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:17.173289    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-556lk_ec75722e-44fb-4444-a909-230de918c211/network-metrics-daemon/0.log"
Jul 06 03:23:17.191255 ip-10-0-139-33 kubenswrapper[2557]: I0706 03:23:17.191235    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-556lk_ec75722e-44fb-4444-a909-230de918c211/kube-rbac-proxy/0.log"